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Abstract 

In this paper, we consider the extreme behavior of a Gaussian random field f(t) living on 
a compact set T. In particular, we are interested in tail events associated with the integral 
f T ef^dt. We construct a (non-Gaussian) random field whose distribution can be explicitly 
stated. This field approximates the conditional Gaussian random field / (given that J T e fW dt 
exceeds a large value) in total variation. Based on this approximation, we show that the tail 
event of J T e^^dt is asymptotically equivalent to the tail event of sup T 7(i) where j(t) is a 
Gaussian process and it is an affine function of f(t) and its derivative field. In addition to the 
asymptotic description of the conditional field, we construct an efficient Monte Carlo estimator 
that runs in polynomial time of log b to compute the probability P(f T e^^'dt > b) with a 
prescribed relative accuracy. 

1 Introduction 

Consider a Gaussian random field {/(i) : t £ T} living on a <i-dimensional domain T C R d with zero 
mean and unit variance, that is, for every finite subset {t\, ...,i n } C T, (/(ti), ...,f(t n )) is a mean 
zero multivariate Gaussian random vector. Let /j,(t) be a (deterministic) function and a E (0, oo) 
be a scale factor. Define 

Z(T) 4 f e af ^ + ^dt. (1) 



JT 

In this paper, we develop a precise asymptotic description of the conditional distribution of / given 
that I(T) exceeds a large value b, that is, P(-\I(T) > b). In particular, we provide a tractable total 
variation approximation (in the sample path space) for such conditional random fields based on a 
change of measure technique. In addition to the asymptotic descriptions, we design efficient Monte 
Carlo estimators that run in polynomial time of log b for computing the tail probabilities 

v(b) = P (X(T) >b) = p(^j e^V+^dt > b^j (2) 

with a prescribed relative accuracy. 

Applications. The integral of exponential functions of Gaussian random fields plays an impor- 
tant role in many probability models. We present a few such models. In spatial point process 
modeling, let X(t) be the intensity of a Poisson point process on T, denoted by {N(A) : A C T}. In 
order to build in spatial dependence structure, the log-intensity is typically modeled as a Gaussian 
process, that is, logA(i) = f(t) + fj,(t) and then E[N(A)\X(-)\ = j A e f ^ + ^dt, where fi(t) is the 
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mean function and f(t) is a zero-mean Gaussian process. For instance, [20] considers the time series 
setting in which T is a one dimensional interval, fi(t) is modeled as the observed covariate process 
and f(t) is an autoregressive process; see [231 032 IS2 Ell E2] for more examples. Under this setting, 
one can show that P(N(T) > b) ~ P(J T e^+^dt > b) as 6 — > oo (see [36]). 

In portfolio risk analysis, consider a portfolio of n assets Si,...,S n . The asset prices are usu- 
ally molded as log- normal random variables. That is, let Xj = log Si and (X\, ...,X n ) follows a 
multivariate normal distribution. The total portfolio value S = Y27=i &i is the sum of dependent 
log- normal random variables (see [22 HI [HI EH El] ) • [7] derives the tail asymptotics of S when n 
is a fixed number. This asymptotic approximation can also be obtained by a more general result 
in [28]. If one can represent each asset price by a Gaussian random field at one location, that is, 
Xi = f(U), then as the portfolio size becomes large and the asset prices become more correlated, 
the unit share price of the portfolio admits the limit lim n _ s . 00 S/n = jeJ^M{t) for some positive 
measure . See [HI [36] for detailed discussions on the random field representations of large 
portfolios. 

In option pricing, the asset price (as a function of time) is typically modeled as a geometric 
Brownian motion ([13 [38]), that is, S(t) = e w{ ^\ where W(t) is a Brownian motion. Then the 
payoff of an Asian call option with strike price K is max {Jo eW{t) dt - K,0). The probability 
P(Jq e w ^dt > K) is the expected payoff of a digital Asian call option. 

The literature. In the probability literature, the extreme behaviors of Gaussian random fields 
have been studied extensively. The results range from general bounds to sharp asymptotic approx- 
imations. An incomplete list of works includes [30l [32l EH S21 H3 HZl H21 E31 [H]. A few lines of 
investigations on the supremum norm are given as follows. Assuming locally stationary structure, 
the double-sum method (|41j) provides the exact asymptotic approximation of supy fit) over a com- 
pact set T, which is allowed to grow as the threshold tends to infinity. For almost surely at least 
twice differentiable fields, [H l4"5"l [3] derive the analytic form of the expected Euler-Poicare Charac- 
teristics of the excursion set (x(^4&)) which serves as a good approximation of the tail probability 
of the supremum. The tube method (|43|) takes advantage of the Karhune-Loeve expansion and 
Weyl's formula. A recent related work along this line is given by [40J. The Rice method ([8, 9, 10 J 
provides an implicit description of sup r /(t). The discussions also go beyond the Gaussian fields. 
For instance, [31 J discusses the situations of Gaussian process with random variances. See also [2] 
for discussions on non-Gaussian cases. The distribution of I(T) is studied in the literature when 
f(t) is a Brownian motion ( |491 I26|). Recently, \34\ [36] derive the asymptotic approximations of 
P(X(T) > b) as b — > oo for three times differentiable and homogeneous Gaussian random fields. 

Besides the tail probability approximations, rigorous analysis of the conditional distributions 
of stochastic processes given the occurrence of rare events is also an important topic. In the 
classic large deviations analysis for light-tailed stochastic systems, the sample path(s) that admits 
the highest probability (the most likely sample path) under the conditional distribution given the 
occurrence of a rare event is central to the entire analysis in terms of determining the appropriate 
exponential change of measure, developing approximations of the tail probabilities, and designing 
efficient simulation algorithms (see, for instance, standard textbook [27]). For heavy-tailed systems, 
the conditional distributions and the most likely paths, which typically admit the so-called "one- 
big-jump" principle, are also intensively studied ([SI El [IT]). These results not only provide intuitive 
and qualitative descriptions of the conditional distribution but also shed light on the design of rare- 
event simulation algorithms ([El [TBI [17]) - the best importance sampling estimator of the rare-event 
probability uses a change of measure corresponding to the interesting conditional distribution. In 
addition, the conditional distribution (or the conditional expectations) is also of practical interest. 
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For instance, in risk management, the conditional expected loss given some rare/disastrous event 
is an important risk measure. 

Contributions. In this paper, we pursue along this line for the extreme behaviors of Gaussian 
processes and begin to describe the conditional distribution of / given the occurrence of the event 
{X(T) > b}. In particular, we provide both quantitative and qualitative descriptions of this condi- 
tional distribution. Furthermore, from a computational point of view, we construct a Monte Carlo 
estimator that takes a polynomial computational cost (in log 6) to estimate v(b) for a prescribed 
relative accuracy. 

Central to the analysis is the construction of a change of measure on the space C (T) (continuous 
functions living on T). The application of the change of measure ideas is common in the study of 
large deviations analysis for the light-tailed stochastic systems. However, it is not at all standard 
in the study of Gaussian random fields. The proposed change of measure is not of a classical 
exponential-tilting form. This measure has several features that are appealing both theoretically 
and computationally. First, we show that the change of measure denoted by Q approximates 
the conditional measure P(-|X(T) > b) in total variation as b — > oo. Second, the measure Q is 
analytically tractable in the sense that the distribution of / under Q has a closed form representation 
and the Randon-Nikodym derivative dQ/dP takes the form of a ci-dimensional integral. This 
tractability property has useful consequences. From a methodological point of view, the measure 
Q provides a very precise description of the mechanism that drives the rare event \X{T) > b}. This 
result allows to directly use the intuitive mechanism to provide functional probabilistic descriptions 
that emphasize the most important elements that are present in the interesting rare events. More 
technically, the analytical computations associated with the measure Q are easy (compared to 
the conditional measure) and the expectation E®[-] is theoretically much more tractable than 
E[-\I(T) > b}. Based on this result, we show that the tail event \X(T) > b} is asymptotically 
equivalent to the tail event of sup T j(t) where j(t) is an affine function of f(t) and its derivative 
field d 2 f(t) and j(t) implicitly depends on b. 

Another contribution of this paper lies in the numerical evaluation of v (6). The importance 
sampling algorithm associated with the proposed change of measure yields an efficient estimator 
for computing v(b). An important issue concerns the implementation of the Monte Carlo method. 
The processes considered in this paper are continuous while computers can only represent discrete 
objects. Inevitably, we will introduce a suitable discretization scheme and use discrete (random) 
objects to approximate the continuous processes. A naturally raised issue lies in the control of the 
approximation error relative to the probability v (b). We will perform careful analysis and report 
the overall computational complexity of the proposed Monte Carlo estimators. 

The rest of this paper is organized as follows. In Section [21 we present the main results including 
the change of measure, the approximation of P(-\I(T) > 6), and the efficient Monte Carlo estimator 
of v(b). Proofs of the theorems are given in Sections [3][6l An appendix is added including all the 
supporting lemmas. 

2 Main results 

2.1 Problem setting and notations 

Throughout the discussion, we consider a homogeneous Gaussian random field {f(t) : t 6 T} living 
on a domain T C R d . Let the covariance function be 

C(t-s) = Cov(f(t)J(s)). 
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We impose the following assumptions: 
CI / is homogenous with Ef(t) = and Ef 2 (t) = 1. 
C2 / is almost surely at least three times differentiable with respect to t. 

C3 T is a (i-dimensional Borel measurable compact set of R d with piecewise smooth boundary. 

C4 The Hessian matrix of C(t) at the origin is standardized to be —I, where / is the d x d identity 
matrix. 

C5 For each t € R d , the function C(Xt) is a non-increasing function of A € R + . 

C6 The mean function /j,(t) is three-time differentiable. In addition, it falls into either of the two 
cases: fj,(t) = or the maximum of /i(t) is unique and is attained in the interior of T. 

We define a set of notations constantly used in the later development and provide some basic 
calculations. Let be the conditional measure given {X(T) > &}, that is, 

PZ(f(-)eA)=P(f(.)eA\l(T)>b). 

Let "<9" denote the gradient and "A" denote the Hessian matrix with respect to t. The notation 
"9 2 " is used to denote the vector of second derivatives. The difference between d 2 f(t) and A/(t) 
is that A/(i) is a d X d symmetric matrix whose diagonal and upper triangle consist of elements 
of d 2 f(t). Furthermore, let djf(t) be the partial derivative with respect to the j-th element of t. 
Lastly, we define the following vectors 

Ati(t) = -(d 1 C(t),...,d d C(t)), (3) 
H2(t) = (dl i C(t),i = l,...,d;d 2 j C(t),i = l,...,d-l,j = i + l,...,d), 

^02 = /*20 =A»2(0). 

Suppose G T. It is well known that (c.f. Chapter 5.5 of [3]) (f(0),d 2 f(0),df(0)J(t)) is a 
multivariate Gaussian random vector with mean zero and covariance matrix 
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where the matrix H22 is a d(d+l)/2-dimensional positive definite matrix and contains the 4th order 
spectral moments arranged in an appropriate order according to the order of elements in d 2 f(0). 
Let h(x,y,z) be the density function of (f(t),df(t),d 2 f(t)) evaluated at (x,y,z). Then, simple 
calculations yield that 



det(T) 
2-k) 

where det(-) is the determinant of a matrix and 



„t„ 1 (^-^o^a 1 ^) 2 ,t„-i. 
3/ {/+- =1 i-z M22 ■■ 



h(x,y,z) = — js+mm e , (4) 

(27r) 4 
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We define function of b such that 



{^y u -ie^ = b. (5) 

Note that the above equation generally has two solutions, one is approximately <7 _1 log& and the 
other is close to zero. We choose u to be the one close to cr" 1 logfe. For /i(t) and a appearing in 
(PQ), we define 

= fJ.(t)/a, u t = u-n a {t). (6) 

Approximately, ut is the level that f(t) needs to reach so that X(T) > b. Furthermore, we need the 
following spatially varying set: 

A t = {/(■) € C{T) : a t > u t - t?^ 1 } , (7) 

where n > is a tuning parameter that will be eventually sent to zero as b — > oo and at is a function 
of f(t) and its derivative fields taking the form of 

2ut Zaut ut 
In the above equation flS}, f" is defined as (with the notations in ©) 

fl = d 2 f(t)-u tm . (9) 

The term Bt is a deterministic function depending only on C(t), //(t), and u, 

s. = lTaV(t> ; c ' Xfe(i) + ^E^(°) + i^('>i 2 . ("» 

i 

where d is the dimension of T, and 1 = (1, 1, 0, ...,0 ) T . Note that at ~ /(£)• Thus, on the set 

ci d(d-l)/2 

^, /(t) a t > u t - Oiu' 1 ). Together with the fact that E[d 2 f(t)\f(t) = u t ] = u tj u 2, ft is the 
standardized second derivative of / given that f(t) = ut- In Section 12.21 we w iU show that the 
event {I(T) > b} is approximately UtgT^t- 

For notational convenience, we write a u = 0(b u ) if there exists a constant c > independent 
of everything such that a u < cb u for all u > 1, and a u = o(b u ) if a u /b u — > as u — > oo and the 
convergence is uniform in other quantities. We write a u = Q(b u ) if a u = 0(b u ) and b u = 0(a u ). In 
addition, we write a u ~ b u if a u /b u — >■ 1 as u — > oo. 

Remark 1 Condition CI assumes unit variance. We treat the standard deviation a as an ad- 
ditional parameter and consider J e^ t ' Jra ^ t ' dt. Condition C2 is rather a strong assumption. It 
implies that C{t) is at least 6 times differentiable and the first, third, and fifth derivatives at the 
origin are all zero. Differentiability is a crucial assumption in this analysis. Condition C3 restricts 
the results to finite horizon. Condition C4 is introduced to simplify notations. For any Gaussian 
process g(t) with covariance function C g (t) and AC 9 (0) = — S and det(S) > ; C4 can be obtained 
by an affine transformation by letting g(t) = f(Y, l l 2 t) and 



f e Kt)+^W^ = det (E- 1 / 2 ) f 



'{s-.s-y^seT} 

Conditions C5 is imposed for technical reasons so that we are able to localize the integration. For 
condition C6, we assume that fi(t) is either a constant or attains its global maximum at one place. 
If fi(t) has multiple (finitely many) maxima, the techniques developed in this paper still apply, but 
the derivations will be more tedious. Therefore, we stick to the uni-mode case. 
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Remark 2 The setting in (J2]) also incorporates the case in which the integral is with respect to 
other measures with smooth densities. Then, if v(dt) = n(t)dt, we will have that 

e ^)+°m v{dt) = f e K*)+iog*(t)-Hr/(t) dtj 

A J A 

which shows that the density can be absorbed by the mean function. 

2.2 Approximation of the conditional distribution 

In this subsection, we propose a change of measure Q on the sample path space C(T) that ap- 
proximates P£ in total variation. Let P be the original measure. The measure Q is defined such 
that P and Q are mutually absolutely continuous. We define the measure Q under two different 
scenarios: p(t) is not a constant and p(t) = 0. Note that the measure Q obviously will depend on 
b. To simplify the notations, we omit the index b in Q whenever there is no ambiguity. 

The measure Q takes a mixture form of three measures, which are weighted by (1 — p\ — p<z), 
Pi, and p2 respectively (a natural constraint is that pi, p2, and 1 — p\ — p2 £ [0, 1]). We define Q 
through the Radon-Nikodym derivative 

^ = (1 - Pl - p 2 ) [ l(t) ■ LR{t)dt + Pl [ l(t) ■ LR^dt + p 2 [ ^j^dt, (11) 
dP J T J T J T mes{T) 

where pi,p2 will be eventually sent to as b goes to infinity, mes(T) is the Lebesgue measure of 
T, and 

h , t (f(t),df(t),d*f(t)) rn h lit (f(t),df(t),d*f(t)) 7^ e ~ Um ~ Ut? 

LK[t) - h(f(t),df(t),dif(t)) ' LKl[t) ~ h(f(t),df(t),d*f(t)) ' LK2[t) - i e -^/w 2 • 

(12) 

The density h (/ (t) , d f '(t) , d 2 f (t)) is defined in ([!]), l(t) is a density function on T, ho it and h\ :t 
are densities of (/(i), df(t), d 2 f(t)) . Before presenting the specific forms of l(t), foo,*> arid h\ tt , we 
would like to provide an intuitive explanation of dQ/dP from a simulation point of view. One can 
generate f(t) under the measure Q via the following steps: 

1. Generate i ~Bernoulli(/J2)- 

2. If i = 1, then 

(a) Generate r uniformly from the index set T, i.e., r ~ Unif(T). 

(b) Given the realized r, generate f(r) ~ N(u T , 1). 

(c) Given (r, /(t)), simulate {f(t) : t / r} from the original conditional distribution under 
P. 

3. Ifz = 

(a) Simulate a random variable r following the density function l(t). 

(b) Given the realized r, simulate /(t) = x, df{r) = y, d 2 f(r) = z from density function 

h a ii(x, y, z) = Pl — —h , T {x, y, z) + - Pl h l T (x, y, z). (13) 

1 — p 2 1 — P2 
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(c) Given (t, /(t), <9/(t), <9 2 /(r)) , simulate {f(t) : t 7^ r} from the original conditional 
distribution under P. 



Thus, r is a random index at which we twist the distribution of / and its derivatives. The likeli- 
hood ratio at a specific location r is given by LR(t), LRi(t), or LR,2(t) depending on the mixture 
component. The distribution of the rest of the field {/(t) : t 7^ r} given (/(r), df(r), d 2 f(r)) is the 
same as that under P. It is not hard to verify that the above simulation procedure is consistent 
with the Radon-Nikodym derivative in (llip . 

We now provide the specific forms of the functions defining Q. We first consider the situation 
when 7^ 0. By condition C6, /i(t) admits its unique maximum at t* = argsup 4eT /i(t) in the 
interior of T. Furthermore, the Hessain matrix A/x cr (t !H ) is negative definite. The function l(t) is a 
density on T such that for t G T 



l(t) = (l + o(l))det(A/, (T (^)) 1 /2 {^) d '\ 



which is approximately a Gaussian density centered around t*. The functions ^o,t an d ^1 t are 
density functions of (f(t), d f (t) , d 2 f (t)) defined as follows (we will explain the following complicated 
functions momentarily) 



h 0!t (f(t),df(t),d 2 f(t)) 



h ltt (f(t),df(t),d 2 f(t)) 



lA t x H\ x ut x e V / x e 2 



x exp 




l/2-i 

,-1/2 J// /^22 1 
P22 it 



2rr 



\Sf(t)\ 

x e 2 



i/2 1 

, -1/2 j// A^22 1 
/^22 /t 



where I is the indicator function, A t = {/(■): f(t) + 2u { — h 2g ^* + ^ > ut — i]/ u t} is defined as 
in /" is defined as in Q, A < 1 is positive and it will be sent to 1 as b goes to infinity, Ai is a 
fixed positive constant (e.g., Ai = 1), and the normalizing constants are defined as 



Hi 



" Ar >(l - A) d / 2 A 



(27T) 



|M20M 22 z 

=1 

-M20M 2 2 M 02 



''l>2 



1/2, 



1/2, 
^22 1 



z g_Rd(d+l)/2 



(15) 



H\ 1 



e x ^(l + Ai) d/2 Ai 
(2vr)2 



1 -1 |2 

|M20M 2 2 2 

; =1 

^-^20^22 M02 



A*22 



1/2. 



1/2. 
M 2 2 1 



zeR d(d+l)/2 



The constants H\ and ensure that hoj and /ii,t are properly normalized densities. 



Understanding the measure Q. The measure Q is designed such that the distribution of / 
under the measure Q is approximately the conditional distribution of / given X(T) > b. The two 
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terms corresponding to the probabilities p\ and p2 are included to ensure the absolute continuity 
and to control the tail of the likelihood ratio. Thus, p\ and p2 will be sent to zero eventually. 

We now provide an explanation of the leading term corresponding to the probability 1 — pi — p2 ■ 
To understand hoj, we use the notation at in ([8]) and rewrite the density function as 

h 0tt (f(t),df(t),d 2 f(t)) oc l At exp{-Xu t (a t - Ut )} x exp |-^|5/(t)| 2 | 



x exp 



\H20P22ftY 

"T~ 

1 — ^20/^22 M02 



1/2.. 

-1/2 j// P22 1 
^22 Jt 



2a 



which factorizes into three pieces consisting of at, df(t), and f" respectively. We consider the 
change of variables from {f(t),df(t),d 2 f(t)) to (at,df(t), /"). Then, under the distribution hoj, 
the random vectors at, df(t), and fj.' are independent. Note that /io,t is defined on the set At = 
{at > ut — iju^ 1 } where rj will be send to zero eventually. Then, at — ut is approximately an 
exponential random variable with rate Xut, df(t) and f" are two independent Gaussian random 
vectors. The density h\ s t has a similar interpretation. The only difference is that h\ s t is defined on 
the set {at — ut < —i]^ 1 } and ut — at follows approximately an exponential distribution. For the 
last piece corresponding to P2, the density is simply an exponential tilting of f{t). 

Under the dominating mixture component, to generate an f(t) from Q, a random index r is 
first sampled from T following density l(t), then (/(r), df(r), d 2 f{r)) is sampled according to ho jT . 
This implies that the large value of the integral f T e^ +a f^ dt is mostly caused by the fact that 
the field reaches a high level at t; more precisely, a T reaches a high level of u T (with an exponential 
overshoot of rate Xu T ). Therefore, the random index r localizes the position where the field at goes 
very high. The distribution of r given as in (|14p is very concentrated around t*. This suggests that 
the maximum of at (or f(t)) is attained within O p (n -1 / 2 ) distance from t*. 

We now consider the case where p(t) = 0. We choose l(t) to be the uniform distribution over 
set T and have that 

^ = (l-pi-p 2 ) / l —--LR{t)dt+py [ 1 —-LR 1 (t)dt + P 2 [ 1 —-LR2(t)dt, (16) 

dP Jt mes(T) Jt mes(T) J T mes(T) 

where mes(-) is the Lebesgue measure. The following theorem states that Q is a good approximation 
of P£ with appropriate choice of the tuning parameters. 

Theorem 3 Consider a Gaussian random field {f(t) : t £ T} living on a domain T satisfying 
conditions Cl-6. Then, for any e > 0, there exist bo, rj, p\,p2, X and X± such that Q approximates 
P£ in total variation, that is, for all b > 60 

S up\Q(A)-PZ(A)\<e. 
Act 

Remark 4 In particular, as e becomes small, we will send rj,pi,p2 — > 0, A — > 1—, and X\ stays 
as a constant. Theorem is the central result of this paper. We present its detailed proof. The 
technical developments of other theorems are all based on that of Theorem O Therefore, we only 
layout their key steps and the major differences from that of Theorem [3 

Remark 5 The measure corresponding to the last mixture component in (jlip . J T dt, has been 

employed by f3b^ to develop approximations for v(b). We emphasize that the measure constructed in 
this paper is substantially different. In fact, the measure corresponding to LR2(t) does not appear 
in the main proof. We included it to control the tail of the likelihood ratio in one lemma. 
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To illustrate the application of the measure Q, we provide a further characterization of the con- 
ditional distribution P£ by presenting another approximation result which is easier to understand 
at an intuitive level. Let 

7«(t) = /(*) + + — + Pu(T) = sup 7u (t), P 6 (/(.) eA) = P (/(•) e A\p u (T) > u) . 

The process 7 u (i) is slightly different from at- The following theorem states that the measure Q 
also approximates the distribution Pf, in total variation for b large. 

Theorem 6 Consider a Gaussian random field {f(t) : t E T} living on a domain T satisfying 
conditions Cl-6. Then, for any e, with the same choice of tuning parameters as in Theorem^ Q 
approximates Pf, in total variation, that is, for all b > bo 

sup \Q(A)-P b (A)\ <e. 
2.3 Some implications of the theorems 

The results of Theorems [3] and 0] provide both qualitative and quantitative descriptions of P£. From 
a qualitative point of view, Theorems [3] and H] suggest that 

sup|i?(.A)-n(4)|->0, (17) 

as b — > oo. Note that 7 u (t) itself is a Gaussian process. Thus, the above convergence results connect 
the tail events of the exponential integral to the supremum of another Gaussian process that is a 
linear combination of / and its derivative field. We emphasize that classic results (e.g. those in 
the introduction) do not (directly) apply to j u (t) in that j u (t) is indexed by u (a function of b). 
Nonetheless, the result in (|17p together with our previous explanation of the measure Q provides a 
qualitative description of P£ given that the high excursion of the supremum of Gaussian processes 
is much more intensively studied in the literature than the integral T{T) and the distribution of / 
under Q has a closed form representation. 

From a quantitative point of view, Theorem [3] implies that for any bounded function E : C(T) — > 
R the conditional expectation E[B(f)\X(T) > b] can be approximated by £^[H(/)], more precisely, 

E[E(f)\l(T)>b]-El[3(f)}^0 (18) 

as b — > oo. The expectation [£,(/)] is much easier to compute (both analytically and numerically) 
via the following identity 

E Q [E{f)] = E Q [ E[E{f)l hTj{T ^ df{T ^ d 2 f{T)] ] (19) 

Note that the inner expectation is under the measure P in that the conditional distribution of 
/ given (/(r), 9/(r), 9 2 /(r)) under Q is the same as that under P. Furthermore, conditional on 
(/(t), <9/(t), d 2 f(r)), the process f(t) is also a Gaussian process and has the expansion 

fit) = f(r) + df(r) T (t -r)+ l -(t- r) T A/(r)(i - r) + o(\t - r| 2 ). 
These results provide sufficient tools to evaluate the conditional expectation 

E[B{f)^Tj{r),df{r),d 2 f{r)\. 
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Once the above expectation has been evaluated, we may proceed to the outer expectation in (1191) . 
Note that the inner expectation is a function of (z, r, / (r) , df (r) , <9 2 / '(r)) , the joint distribution of 
which is in a closed form. Thus, evaluating the outer expectation is usually an easier task. In fact, 
the proof of Theorem [3] is an exercise of the above strategy by considering that S(/) = (dP/dQ) 2 . 

Remark 7 According to the detailed proof of Theorem^ the approximation (|18|) is applicable to all 
the functions such that sup^ E\z?{f)\Z(T) > b] < oo. To see that, we need to change the statement 
and the proof of Lemma\12\ presented in Section^ 



2.4 Efficient Rare-event Simulation for X(T) 

In the preceding subsection we constructed a change of measure that asymptotically approximates 
the conditional distribution of / given X(T) > b. In this section, we construct an efficient importance 
sampling estimator based on this change of measure to compute v(b) as b — > oo. We evaluate the 
overall computation efficiency using a concept that has its root in the general theory of computation 
in both continuous and discrete settings |39^ 146] . In particular, completely analogous notions in 
the setting of complexity theory of continuous problems lead to the notion of tractability of a 
computational problem 



Definition 8 A Monte Carlo estimator is said to be a fully polynomial randomized approximation 
scheme (FPRAS) for estimating v(b) if, for some qx, qi, and d > 0, it outputs an averaged estimator 
that is guaranteed to have at most e > relative error with confidence at least 1 — 5 € (0, 1) in 
0(e~ qi 5~ q2 \ logv(b)\ d ) function evaluations. 

Equivalently, one needs to compute an estimator Z b with complexity 0(e~ qi 5~ q2 1 log v (b)\ d ) such 
that 

P(\Z b /v(b)-l\>e)<6. (20) 

In the literature of rare-event simulations, an estimator L b is said to be strongly efficient in esti- 
mating v(b) if EL b = v(b) and sup b VarL b /v 2 (b) < oo. Suppose that a strongly efficient estimator 
L b has been obtained. Let {L^ : j = 1, ...,n} be i.i.d. copies of L b . The averaged estimator 



1 n ( 



n 

-U) 



has a relative mean squared error equal to y/E(Z b /v(b) - l) 2 = Far 1 / 2 (L b ) n 1 l 2 v(b) 1 . A simple 
consequence of Chebyshev's inequlity yields 



P(\Z b /v(b) - 1| > e) < 



Var{L b ) 
e 2 nv 2 (b) 



Thus, it suffices to simulate n = 0(e~ 2 5~ 1 ) i.i.d. replicates of L b to achieve the accuracy in (|20l) . 

The so-called importance sampling is based on the identity P(A) = E^^^dP/dQ]. The random 
variable lAdP/dQ is an unbiased estimator of P{A). It is well know that if one chooses Q(-) = P(-\A) 
then ^dP/dQ has zero variance. The measure Q created in the previous subsection is a good 
approximation of P b * and thus it naturally leads an estimator for v(b) with small variance. 

In addition to the variance control, another issue is that the random fields considered in this 
paper are continuous objects. Computer can only perform discrete simulations. Thus, we must 
use a discrete object approximating the continuous field to implement the algorithms. The bias 
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caused by the discretization must be well controlled relative to v(b). In addition, the complexity 
of generating one such discrete object should also be considered in order to control the overall 
computational complexity to achieve an FPRAS. 

To start with, we create a regular lattice covering T in the following way. Let G]\r,d be a subset 
of R d containing 

n JY *i «2 id\ . 

° N ' d ~ {{n'W-'nj -'*«' g 

That is, Gn4 is a regular lattice on R d . For each t = (t 1 , • ■ • , t ) € Gna, define 

T N (t) = {(a 1 , ■ • • .a*) € T : s>' € (*>' - 1/iV, for j = 1, ■ ■ ■ , d] 

that is the -^-cube intersected with T and cornered at t. Furthermore, let 

T N = {t G G^d : ?iv(t) / 0}. (21) 

Since T is compact, T/v is a finite set. We enumerate the elements in Tj\r = {ti, • • • , tjvf}, where 
M = 0(N d ). We further define 

x = (x ir .. ,X M ) T ^(/(h),... J(t M )) T 

and use 

v M {b) = P {1 M {T) >b) 

as an approximation of v(b) where 

AI 

X M (T) = Y,mes{T N {t l )) x e ^+^\ (22) 

i=l 

We have the following theorem to control the bias. 

Theorem 9 Consider a Gaussian random field f satisfying conditions in Theorem [3 For any 
£o > 0, there exists kq such that for any e G (0, 1), if N > kqE~ 1 ~ £0 (log b) 2+£0 , then for b > 2 

\v M (b)-v(b)\_ <£ 



v(b) 

We estimate %(&) using a discrete version of the change of measure proposed in the previous 
section. The specific algorithm is given as follows. 

1. Generate a random indicator i ~Bernoulli(/92)- If i = 1, then 

(a) Generate i uniformly from {1, M}. 

(b) Generate X L ~ N(u ti ,l). 

(c) Given (t L ,X b ), simulate the joint field (f(t),df(t),d 2 f(t)) on the lattice T^\{t L } from 
the original conditional distribution under P. 

2. If * = 

(a) If fi(t) is not constant, simulate a random index i proportional to l(t L ), that is, P(l = 
i) = l(ti)/n and k = YldLi K^i)'i ^ — 0' then t is simulated uniformly over {1, ...,M}. 
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(b) Given the realized l, simulate f(t L ) = X L = x,df(t L ) = y,d 2 f(t L ) = z from density 
function 

Ku{x,y,z) = — h 0:ti (x,y,z) + hi A (x,y,z). 



1-/02 



1-/02 



(c) Given (t L , f(t L ),df(t L ),d 2 f(t L )), simulate the joint field (f(t),df{t),d 2 f(t)) on the lattice 
T/v\{t t } from the original conditional distribution under P. 



3. Output 



I 



{X M (T)>b} 



l-pi-p 2 v^Af 



£•=! l(U)LR(U) + £ Efii l(U)LRi{U) + p 2 EZi wLR 2 ( ti 



M 1 



(23) 



Let Qm be the measure induced by the above simulation scheme. Then, it is not hard to verify 
that Lb = I{x M (T)>b}dP/dQM and thus Lb is an unbiased estimator of vm(o)- The next theorem 
states the strong efficiency of the above algorithm. 

Theorem 10 Suppose f is a Gaussian random field satisfying conditions in Theorem 0. If N is 
chosen as in Theorem^ and all the other parameters are chosen as in Theorem^ then there exists 
some constant k\ > such that 



eQmlI 



sup 



6>1 «jf(») 



< 



«1. 



Let Zb be the average of n i.i.d. copies of Lb- According to the results in Theorem [9j we have 



that 



v(b) 



< 



vmQ>) 



(v M (b)/v(b) - 1) 



+ 



Z h 



v M (b) 



< e 



Z h 



vu{b) 



+ 



Zn 



vmQ>) 



The results of Theorem [10] suggest that 



P(\Z b /v M (b) - 1| > e) < 



e 2 n 



If we choose n = K\e 5 , then 



P{\Z b /v{b) - 1| > 3e) < 5. 



Thus, the accuracy level as in (I20j) has been achieved. Note that simulating one Lb consists of 
generating a multivariate Gaussian random vector of dimension M x (d + l)(d + 2)/2 = 0{N d ) = 
0((log 6)( 2+e o)^ e -(i+eo)rf^ _ xhe complexity of generating such a vector is at the most 0(N 3 ). Thus, 
the overall complexity is O (e _2_ ( 3+3e °^5 _1 (log fr)( 6 + 3£ o)^ _ The proposed estimator in ([2"3"j) is a 
FPRAS. 



Remark 11 The proposed algorithm can also be used to compute conditional expectations via the 
representation E[E(f)\l(T) > b] = E[E(f);l(T) > b]/v(b), where E[E(f);l(T) > b] can be esti- 
mated by E(f)dP/dQM and v(b) can be estimated by I{z(T)>b}dP / dQ m ■ 
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3 Proof of Theorem [3] 

We use the following simple yet powerful lemma to prove Theorem [3j 

Lemma 12 Let Qo and Q\ be probability measures defined on the same o-field T such that dQi = 
r~ 1 dQo for a positive random variable r. Suppose that for some e > 0, E® 1 [r 2 ] = E^°[r] < 1 + e. 
Then, 

sup \E Ql (X) - E Qo (X)\ < e 1/2 . 

Proof of Lemma 1121 

\E Ql (X) - E Qo (X)\ = \E Ql [(1 - r)X]\ 

<E^\r-l\< [E* (r - I) 2 ] 1 ' 2 = (E^ [r 2 ] - l) 1/2 < e 1 ' 2 . 



We also need the following approximations for the tail probability v(b) (see Theorem 3.4 and 
Corollary 3.5 in 



Proposition 13 Consider a Gaussian random field {f(t) : t £ T} living on a domain T satisfying 
conditions Cl-6. If fi(t) has one unique maximum in T denoted by t*, then 



v(b) ~ (27r) d / 2 det(A / u CT (t,))- 1 /2 G (^) . u d/2-i exp 
where u is as defined in ([5]), G{t) is defined as 



det(r)" 



(d+l)(d+2) 

(2ir) 4 



e 8<r^ 



-+B t 



exp < 



I — 1 |2 

1^20/^22 z \ 

1 — ^20^22Vo2 



+ 



I Z(iRd(d+±)/2 

If /j,(t) = 0, G(t) is a constant denoted by G. Then, 

v{b) ~ mes 



1/2- 

-1/2 _ ^22 1 
^22 * 2a 



dz. 



3.1 Case 1: n(t) is not a constant 

To make the proof smooth, we arrange the statement of the rest supporting lemmas in Section [7J 
We start the proof of Theorem [3] when jj,{t) is not a constant. Note that 



E Q 



dPl 
dQ 



,{b)~ 2 E Q 



Thanks to Lemma [T2l we only need to show that as b 



oo 



E Q 



E Q 



E?, 



< {l + e)v{bf 
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where we use the notation E® T [ ■ ] = E®[ ■ \ i,t] to denote the conditional expectation given i and 
r. t G T is the random index described as in the simulation scheme admitting a density function 
l(t) if i = and mes- l (T)l T {t) if i = 1. Note that 



— ) ;X(T)>6 /(r),0/(r),a 2 /C 



For the rest of the proof, we mostly focus on the conditional expectation 

' (dP^ 2 



v — J ;l(T)>b f(r),df(r),d 2 f(r) 



The rest of the discussion is conditional on i and r. To simplify the notations, for a given r, we 
define 

f*(t)= f(t)-U T C(t-T). 

On the set {X(T) > 6}, /(r) reaches a level tt r , and E[f(t)\f(r) = u T ] = u T C(t — r). Thus, f*(t) is 
the field with the conditional expectation removed. From now on, we work with this shifted field 
f*(t). Correspondingly, we have 

df*(t) = 9f(t) - u T dC(t - r), d 2 ut) = d 2 f(t) - u T d 2 C{t - t). 

We further define notations 

w = f*(r), y = df*(r), z = d 2 f*(T), z = A/*(t), 
y = (9/*(t) + dna(r), z = A/*(t) + /J, a (r)I + A// CT (r), 
w t = f*(t), y t = df*(t), zt = <9 2 /*(i), z t = d 2 ,/■*(£) - innm- 



(24) 



Under the measure Q and a given r, if i = 0, (to, y, z) has density function 



— ; h Q Aw, y, z) + - h-L Jw, y, z); 

1-/02 1-P2 



(25) 



if z = 1, then (w,y,z) follows density h*(w,y,z). The forms of the densities can be derived from 
ho,t, hi t t, and h. In particular, their expressions are given as follows 

,* / \ , i , f lT z B A i, l2 " 

h (w,y,z) oc I At x exp i -Xu T [w + 1 



2<7M T 1i r 



x exp 



— 1 |2 



1 — A^o/^Vt^ 

T . 



+ 



M 22 



1/2 1 

1/2 w ^22 1 



2a 



hi T (w,y,z) oc i^xaq^Aiu^ + ^ + ^-i 



x exp < 



K( w iy,z) = h(w,y,z) 



I -l |9 
\P-20P-22 Z \ 

1 - A^OA^VtK 

det(r) 



+ 



1/2- 

-1/2 P 2 2 1 
A*22 * 2cJ 



(d+l)(d+2) 
(27T) 4 



1 _ J_ 

2 2 

e 



l -i l 2 

»-f20M 22 2 , T -1 

3/ =i — ■ — \~z M22 z 

1 ~M20M 2 2 M02 
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and A T = \w + + £± + I7 > -^r 1 } is denned as in (0). 

In the next step, we will compute dQ/dP in the form of f*(t). Basically, we replace f(t) by 
Ut) + u T C(t-r), df(t) by y t + Ur dC(t-T), 8 2 f(t) by z t + u T 8 2 C(t - r), and //' = <9 2 /(t) - W 2 
by Zt + u T d 2 C(t — t). For the likelihood ratio terms LR and Li^x in (fT2]h note that the |<9/(t)| 2 
terms in ho,t and hij cancel with those in h(f(t),df(t),d 2 f(t)), that is, 



H\ ■ u t e 



LR(t) = I At 



dct(r)~? 2 

(rf+l)(d+2) e 
(2tt) 3 

We insert the notations in (1241) and obtain that 



=1 

1-M20M2Q M02 



1/2, 

-1/2 f „ M 22 1 
^22 It 2ct 



(/(t)-M20M 2 " 2 1 S 2 /( t )) 2 

; =1 

1-^20^22 M02 



+a 2 /(t)V 22 1 s 2 /(*) 



Li?(i) = lA t ■ u t H\ exp < —Xu t ( u>t + u T C (i — r) + 



l T (^ + // 2 (t-rK) , 5 



2aut 



H 



x exp 



1 — ^20P 22 P-02 



+ 



1/2 1 

-1/2/- . /. n s ^22 L 

V22 Zt+W-^K 2 



where 



xh x l (w t + u T C(t -r),z t + u T d 2 C(t - r)) 

det(T) _ 5 



t'-"M^') a + ,T^l 2 
1-^20^22 M 02 



(d+l)(d+2) 
(27Tj 4 



(26) 
(27) 



which is the function h(x,y,z) with the |y| 2 term removed. Similarly, we have that 

l T (^ + Ai 2 (t-r)n T ) B 



LJ?i (t) = Ia° ■ u t H Xl exp < Xiu t [w t + u T C(t - t) + 



H it* 



x exp < 



l/"20/U 2 2 1 ( 2; t + M2(£-T)u r )| S 



+ 



1/2 1 

M22 1 



1 - ^20M22 1 M02 

x/i~i + u T C(t -r),zt + u T d 2 C(t - t)) . 
With the analytic forms (|26h and (I28p . we proceed to the likelihood ratio in (llip 



2(7 



— = (1 - pi - p 2 )K + piifi + p 2 K 2 
dP 



(28) 



(29) 



where 



K= I l(t)LR(t)dt, Ki= f l(t)LR x (t)dt, K 2 = l — f e -^ t +u tWt +u t u T c(t-T ) df 

J A* J(A'Y mes(T) J T 

where the set A* (depending on the sample path f*(t)) is defined as 

A * J, . n( . s , \yt + u T -dC(t-r)\ 2 l^(z t +u T p 2 (t-r)) B t ^ r, \ 

A = < t : w t + C (t - t)u t H 1 1 > u t } 

I 2u t 2au t u t u t I 



(30) 
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We may equivalently define A* = {t : f £ A t }. Note that LR(t) = if / ^ A t . Thus, the integral 
of K is essentially on the set A* and K\ is on the compliment of A* . 
Furthermore, we have that 



E Q 



< 



< 



E Q l E Q r 
+E Q IE® 



1 



[(1 -pi- p 2 )K + p x Kx 
1 



r;l(T) > b 



[(l- Pl -p 2 )K] 
1 



where 



[(1 - Pl - p 2 )K + ftKi 



A T = W + ~ h h 



2\I{T) >b,A T >0 
2;X(T)>6,^ r <0 ^ ,(31) 



(32) 

2u T ' 2au T ' u T 

Note that the term K 2 is not used in the main analysis. In fact, K 2 is only used in Lemma [TBI for 
the purpose of localization that will be presented later. The rest of the analysis consists of three 
main parts. 



Part 1 Conditional on (i, r, /*(r), <9/*(r), 9 2 /*(r)) , we study the event 

£ b = {X(T) > b} , 



(33) 



and write the occurrence of this event almost as a deterministic function of /*(t), df^r) 
and 5 2 /*(r), equivalently (w,y,z). 

Part 2 Conditional on (z, r, /*(r), df* (r), 9 2 /*(t)) , we express K and i^i as functions of /*(r) 
df*{ T )i d 2 f*{ T ) with small correction terms. 



Part 3 We combine the results from the first two parts and obtain an approximation of (|3ip . 
All the subsequent derivations are conditional on i and r. 

3.1.1 Preliminary calculations 

To proceed, we provide the Taylor expansions for /*(i), C(t), and p(t). 

• Expansion of /* (t) given (/*(r), 9/*(t), <9 2 /*(r)) . Let t— t = ((i— r)i, (t— t)^). Conditional 
on (/*(t), <9/*(t), 9 2 /*(t)) , we first expand the random function 



where 



.93 



/*(t) = i?[/*(t)|/*(r),5/,(r),5 2 /,(r)] + g(t - r) 

= /*(r) + 9/,(r) T (t - r) + i(t - r) T A/,(r)(i - r) 
+3 3 (t-r) + J R/(t-r)+ 5 (t-r), 



(34) 
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is the third order expansion. Note that df- k f^{r) is independent of (/*(r), A/*(r)) and 

^[^WI/*W,^(r),^4r)]=-^4 H C(0W,W. 

I 

g(t) is a mean zero Gaussian random field such that Eg 2 {t) = 0(|t| 6 ) as t — > 0. In addition, the 
distribution of g(t) is independent of i, r, /*(r), <9/*(r), and d 2 f*{r). — r) = 0(|i — r| 4 ) 
is the remainder term of the Taylor expansion of E [/*(t)|/*(r), 9/*(r), d 2 /*(r)] . 



Expansion of C(t): 



C(t) = 1 - -t T t + C 4 (t) + R c (t), 



where Jfc(t) = 0(|t| 6 ) and C 4 (t) = £ ^,£7(0)^*,. 
• Expansion of 

M(t) = M(r) + dfi(T) T (t - r) + ^ - r) T A/i(r)(t - r) + - r), 

where jR^f - r) = 0(\t - r| 3 ). 
We write 

R(t) = R f (t) + u T R c (t) + Rp(t)/o 
to denote all the remainder terms. For < e < 5 sufficiently small, let 

C = l\r-U\ <u^ 2+e ,\f(r)-u T \ <u l ' 2+ \\df(T)\ <u e ,\d 2 f(r)-u Tm \ < 



ii 



sup \d 3 f(t) - u T d 3 C(t - r)| < u 1/2+t , sup \g(t)\ < u 
By Lemma [TBI whose proof uses the last component LR 2 {t), we have that 

2 



1-5 



E Q 



dpy 



o{l)v\b). 



Therefore we only need to consider the second moment on the set C, that is, 



E Q 



(-)' 
\dQJ 



; £b, £ 



< E Q 
+E Q 



E Q 
E Q 

— 't n 



1 



[(1 - Pl - p 2 )K] 
1 



[(1 - pi - p 2 )K + Pl K x 



(35) 



(36) 



(37) 



(38) 



where K and are given as in (|29p . Note that we can rewrite the localization set in terms of 
f*(t) as 



C = ||r-M < U -^ 2+e ,\w\ < n V2+, 



|y| < u , \z\ < u , 



sup \d 3 Mt)\ < u 1 ' 2 ^, sup \g(t)\ < u 



1-5 



It-rKu-Va+i 



(39) 



We will focus on the terms on the right-hand-side of (|38p in the subsequent derivations. Now, we 
start to carry out each part of the program. 
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3.2 Part 1 



All the derivations in this part are conditional on specific values of i, r, /*(t), <9/*(r), and d 2 f*(r) 
equivalently, i, r, w, y, and z. By definition 



1(T) 



3 <j/»(t)+<7« T C(t-r)+ A ((t) dt 



We insert the expansions in (|34p , (|35p , and (|36p into the expression of I(T) and obtain that 



T(T) 



exp < a 



w + y T (t-r) + -(t- T) T z(t - r) + 53 (i - r) + - r) + 5 (t - r) 



xexp<j -^(t 



x exp <j /x(r) + a//(r) 1 (t - r) + -(t - r) 1 A/i(r)(t - r) + - r) }> dt. 



(40) 



where the first row corresponds to the expansion of wt = f*(t), the second and the third correspond 
to those of C(t) and /i(t) respectively. We write the exponent inside the integral in a quadratic 
form of (t — r) and obtain that 

X(T) = exp{<nt + <7w + ^y 1 (ul - z)~ l y} (41) 

x J exp { - |(i - r - (ul - zy^iul - z) (t - r - (ul - z^y) } 

x exp{o"(73 (t — t) + au T C^ (t — r) + cri? (t — r)} x exp{crg (i — r)}dt, 

where y and z are defined as in (|24p . Let a(s) and 6(s) be two generic positive functions. Then, 
we have the representation of the following integral 



a{s)b{s)ds = E[b{S)} / a{s)ds 

T JT 

where S is a random variable taking values in T with density a{s)/ J T a(t)dt. Using this represen- 
tation and the change of variable that s = (ul — z) x / 2 (t — r), we write the big integral (|4*T|) as a 
product of expectations and a normalizing constant, and obtain that 

1(T) = det(ul — z)" 1 / 2 exp{cra + aw + — y T (ul — z) _1 y} 



(ul-z) ?s+reT 



exp { - |( S - (ul - z)" 1 /2y)T ( s _ {uI _ g)-i/2^ j ds 



x£ 



o-g3((M7-Z) _ ^S , )+cru T C 4 ((n/-Z) _ is)+o-_R((u/-Z)"5S 



X £ 



<ts((u/-Z) _ 2S 



The two expectations in the above display are taken with respect to S and 5 given the process 
g(t). S is a random variable taking values in the set {s : (ul — z)~ l l 2 s + r G T} with density 
proportional to 



-%(s-(uI-Z)- 1 /ly) T (s-iuI-Z)- 1 



(42) 



and S is a random variable taking values in the set js : (ul — z) x / 2 s + r G T} with density pro- 
portional to 

-§(.s-(M/-Z)-V2y) T ( s „( u /_z)-i/2^ +CT53 f( u/ ^ 
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Together with the definition of u that f^-)^ 2 u d / 2 e au = b, we obtain that X(T) > b if and only if 
X(T) = det(ul _z)-V2 e <™+™+p T («/-z)-iy 

x f e -%{s-(uI-Z)-^y) T (s-(uI-zr^y) ds 

J(ui-z)~is+TeT 



xE 



ag 3 ((uI-Z)-y s)+au T C 4 ((uI-Z)-?s)+aR((uI-Z)- ?S 



> (^L) d/2 u -d/2 e au i (43) 



<7 J 



where 



£ u = -ulog {£exp ((u/ - z)4s)] } . (44) 



We take log on both sides and plug in the result of Lemma [19] that handles the big expectation 
term in (|4lfl) . Then, the inequality (H3]l is equivalent to 



w + l-y T (uI - z)~ l y - logdet(7 - vT x z) - ^-{vT l Y + l/a) T ^(u^Y + l/a) 

l T M22l , 1 



8cj 2 u 8a 2 



+ ^E^» c (°) + o ( n " 1 ) >«~ 1 ^. ( 45 ) 



where Y = {y?, i = 1, d; 2jjijjj, 1 < i < j < d} , and 1 = (1, 1, 0, ) . On the set £, 

d d(d-l)/2 

further simplify (145 p using the following facts (see Lemma l20l) 

lo g det(/-^z) = -n-irr(z) + o^ 1 ) = - ^ + ^ (t)) + d " Mt) + o(Q, 

u 



where Tr is the trace of a matrix. Therefore, on the set C, (j45J) is equivalent to 

w + yTy + E.ffO) + 0(u - 1} > (46) 

2it 2cra oo^it 

and further equivalently (by replacing u with it T ) 

w + 1 1 — = h o(u ) > u o- f u . 

2m t 2au T oa z u T 

Using the notations defined as in (jlOp and (|32p . X(T) > 6 is equivalent to 

where A T is defined as in (l32j) . 
3.3 Part 2 

In Part 2, we first consider (1 — p\ — p2)K in the first expectation of (|3ip (which is on the set 
{A T > 0}) and then (1 — pi — P2)-K" + Pi-Ki m the second expectation of (I3TT) , 
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Part 2.1: the analysis of K when A T > 



Similar to Part 1, all the derivations are conditional on (z, r, w, y, z). We now proceed to the second 
part of the proof. More precisely, we simplify the term K defined as in (|29p and write it as a 
deterministic function of (w, y, z) with a small correction term. Recall that 



A" 



l(t)u t H\ exp < — \u t ( w t + u T C(t — r) + 



1 



x exp 



+ 



l T (^+/^ft-rK) | gt 

2<71i( 

H22 2 (zt + H2{t-T)u T ) 



2a 



1 — /^20^22Vo2 

x/i~* (w t + u r C(£ -r),Zt + u T d 2 C(t - r)) eft. 
We plug in the form of /i Xj2 and that are defined in (I27p and (I14D and obtain that 

exp 

A* 

l T (zt + /j 2 (t-rK) B 



(21)^-5 det(T)a • detCA/icrCt.)) 1 ^^'-^ 



x x exp < — Xut [wt + u T C(t — r) + 



x exp 



iMgoMgjjft + Li2(t-T)u 7 

1 - ^20M22 1 / i 02 



+ 



2aut 



M 2 2 Ot + (l2(t-T)u T ) 



H Wt 

Wi 



1/2, 2 
A*22 1 



2(7 



exp S - 



1 — ^201^22^02 
+ (z t + M2(< - T)u T ) T ^i(zt + in{t- t)u t 



tit. 



For some 5' > e, where e is the parameter we used to define £, we further restrict the integration 
region by defining 



A*,|t-r|<-u" 1 +' 5 ' 



exp 



ut*(t - t*) T A/u CT (£„)(i - i*) 



(47) 



xti( x exp < — A«t I it;* + u T C(t — r) + 



Uf 



u t 



x exp 



1^20^22 ( Z t + /^ft ~ T)n r )| 2 
1 — M20M22V02 



+ 



1/2., 

-1/2/- . /. \ \ ^22 
fl 22 (Z t + fl 2 {t ~ t)Ut) 



expi- 



Thus, 



(w t + u T C(t - r) - /XgoMgjXgt + /^Q ~ t)^t)) j 

1 — M20M22V02 
+ («t + M2(* - t) u t) T ^22 ( Z t + M2(* - 1~)«r) j^- 



(d+l)(d+2) d 1 1 /o J/9 

A > (2tt) 4 -2 det(r)5 • det(Afi a (Q) l/2 uZ 2 H x • J 2 . 
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For the rest of Part 2.1, we focus on Z2. With some tedious algebra, Lemma Ell writes Z 2 in a more 
manageable form, that is, Z 2 equals 

f exp f_^(t-t,) T AMM(*-^) + !gl xtif (48) 

J A* ,\t-T\<u-i+ s ' I 2 2 J 

x exp <^ (1 - X)ut [w t + u T C(t - r) - u t ] + (1 - A) — * — * '- — '- - XB t i 

J (w f + h t C(£ - t) - ?x f ) 2 - 2 (w t + n r C(t - r) - n t ) ^20^22 ( z t ~ Mog^t + ~ } , 

x exp < - — r - > or. 

[ 2(1 - m) J 

Lemma [221 implies that {\t — r| < u _1+<5 '} C A*. Thus, on the set {„4 T > 0}, we have A* n {|i - r| < 
} = {|t- T | < n _1+<5 } and we can remove A* from the integration region of Z 2 . In addition, 
on the set L and \t — r\ < u~ 1+s , we have that 

u T - u t C(t -t) = 0(u- 1+2S '), M2 (t - r) = m + 0(|t - r| 2 ), 
K/i 2 (i - r) - u t/ u 20 | = 0(u- 1+25 '), (u r - u t C(i - T))\z t \ = o(l). 

We insert the above estimates to (|48p . Together with the fact that 

ut*(t - t*) T Afj, a (i*)(t- t*) . «fl / 1 h u , fl 2 



expj- ^ + f | = (1 + o(l)) exp |-< }> , 

we have that 

Z 2 ~ uxexp - A-B t „ f 

X f exp { (1 - \)ut [w t + n T (C(t - r) - 1) + - ^(r))] + (1 - A) 



\t-T\<U- 1 + 6 ' I 2 C" 

[ 2(1- //20^22 /^02) J 

Further, we have that 

wf — 2wt/J,20^22 lz t + °(X) w t = + U ■ W ■ C^li" 1 / 24 " 5 ). 

Let Cu = 0{u~ 1 l' 2+& ) and we simplify X 2 to 

X 2 ~ uxexp -u u - XB U S 

x / exp<^ (1 - A)(u T + C«) + w t + u T {C(t - r) - 1) + (^(i) - M T )) 

J|t-r|<u- 1 + i ' I L 



1 T £ 



(1-A)_ ^ 
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In what follows, we insert the expansions in (|34p . (|35p and (|36p into the expression of Z 2 and write 
the exponent as a quadratic function of t — r, and obtain that on the set C 



u x exp I -u 2 — XB tf 



1V22II 
8a 2 J 

x exp I (1 - A)(u T + ( u ) ^(1 + C«)«J + ^ T («/ - z)"^ + 

(i-A)K + Cu) 



|t-r|<u- 1 +*' 



exp 



t-r- (ul - z)- 1 ^ (ul -z)(t-r-(ul - z)~ l y) 



x exp {(1 - \){u T + Cu) [S3(t - r) + -u r C 4 (t - r) + i?(i - r) + g(t - r)]} di, (49) 

where we recall that y = y + dfj, a (r), and z = z + u a (r)I + A/v(r). This derivation is very similar 
to that from (|4"0"j) to ([4T|) . In the last row of the above display, on the set C and \t — r| < n _1+<5 , 

"03 (* - T ) + w 2 C 4 (t - r) + uJ?(t - r) = o(l). 
Therefore, they can be ignored. We consider the change of variable that 

8 = (1 - A) 1 / 2 (u r + Cu) 1/2 (ul - z) l l 2 (t - t) 
and obtain that Z 2 equals (with the terms 53 and C4 removed) 



(1 - \r d / 2 u~ d+l exp { - \B 



. - l T M22l 1 



J 

x exp 1(1 - A)K + C«) ((1 + Cu)w + ^ T (n/ - z)" 1 ^ + 

e -|| S -(l-A) 1 /2( tlT+Cll )l/2 (n /_z)-V2y| 2 ds 



2crn 



xE 



D (l-A)K+C tl )9((l-A)- 1 /2( UT+Ctl )-i/2 (tl/ „z)-i/2 5 /) 



(50) 



where 5 U = {s : |(1 — A) l ^ 2 (u T + Cu) l ^ 2 (ul — z) 1 / 2 s| < u 1+<5 '} and S" is a random variable 
taking values on the set S u with density proportional to 



e 2 



|| S -(l-A) 1 /2 (tlT+Cll) l/2 (n/ _z ) -l/2y| 



We use k to denote the last two terms of ([50]) 

K = [ e -||«-(l-A) 1 / 2 (^+C«) 1 / 2 («/-Z)- 1 /^| 2 ds 



x£ 



3 (i-A)K+C u )9((i-A)- 1 / 2 K+c u )~ 1/2 K-z)- 1/2 s') 



(51) 



It is helpful to keep in mind that k is approximately (27r) d / 2 . We insert k back to the expression 
of Z 2 . Together with the fact that y T (ul — z)~ l y = \y\ 2 /u + o(u~ 1 ), we have 



J 2 ~ K (l-A)- rf / 2 u-^exp{iu 2 t -A^-^^} 

l</| 2 



(52) 



x exp <^ (1 - X)(u T + Cu) (1 + ( u )w + £1- + 



2u T 2au T 
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Thus, we have that on the set {A T > 0}, 

K > (2 7 r) (d+1) 4 (d+2) -f det(r)3 . det(A^ (7 (t,)) 1 / 2 ^ /2 J ff A • 1 2 

= (k + o(l))(27r) (d+1) i d+2) -f det(r)3 • det(A/v(**)) 1/2 i?A • (1 - \y d / 2 u~ d / 2+1 

1 .2 ^ lT M2 2 i , „ , , , , , \y\ 2 , i T ^ 



x exp |-< - AS, - _^L_ + (1 _ A)K + Cu)[{1 + ^ + _ , 

We further insert the ^4 T defined in (1321) into (1531) and obtain that 



K > (k + o(1))(2tt) (d+1) 4 (d+2) -f det(r)l • det(A/v(**)) 1/2 #A ■ (1 - A)- d/2 ir d / 2+1 

x exp |i< - St. - ^£fi + (1 - A)u T (l + (1))A + (1 - A)Cn • (|y| 2 + |z|) } . (54) 

Part 2.2: the analysis of dP/dQ when Ar < 

In this part, we focus mostly on K\ term, whose handling is very similar to that of K. Therefore, 
we only list out the key steps. For some large constant M, let 

D = {\t — t — (ul — z) _1 y| < Mu~ 1 } 

that is the dominating region of the integral. We split the set D = (A* n D) U ((^4*) c n D). There 
are two situations: mes((A*) c n D) > mes(A* n D) and mes((A*) c Ci D) < mes(A* n -D). For the 
first situation, the term K\ is dominating; for the second situation, the term K (more precisely Z 2 ) 
is dominating. 

To simplify K\, we write it as 

(d+l)(d+2) d 1 i In 10 

K x = (2vr) 4 ~2det(r)2 ■det(A/i fT (t,)) 1 / 2 < /2 ff Al x 

— (2^) (d+1) i d+2) -| det(T)3 • det(A / i (T (t,)) 1 /2 n J/ 2 ^ Ai x [Z lj2 +Z li3 ] . 

Note that the difference between K\ and K is that the term "—A" has been replace by "Ai". With 
exactly the same derivation for (jlSj) . we obtain that X\ 2 equals (by replacing "—A" in (jIHj) by "Ai") 



... + 

(A*) c nD J(A*) c nD c 



I, 



(A*) c nD 



exp { _^(t-UVA^(Q(t-tA + 1 ' x ^ (55) 



2 2 



\ f -\ 1 \ \ r , ^/ + \ 1 , n , \ \ lT ( Zt ~ ^02 u t + M2(* ~ r)Ur)) l 1 J^l 

x exp <^ (1 + Ai)u t [io t + u T C(t - t) - u t \ + (1 + Ai) — h AiB* 

x exp f (w f + H T C(t - t) - ?x f ) 2 - 2 (w f + (n T C(t - r) - n t )) /xgo/^^ - /i 02 n t + ^ 2 (£ ~ ^KQ) j ^ 

2(1 - M20M22V02) 



Ji )2 ~ uexp <{ ^ + Aifit, - 1 Z 221 [■ (56) 



With a very similar derivation as in Part 2.1, in particular, the result in (|49p . we have that 

2 ** * 80- 2 

x exp |(1 + Ai)(n T + ( u ) ^(1 + (> + ^y T (u/ - z)"^ + | 

x / expi(l + Ai)(u r + C«) -J(t-r-(n/-z)- 1 y) T (uI-z)(t-r-(Ml-z)- 1 y) 1 

J(A*) c nD I L 1 J J 

x exp {(1 + Ai)(« T + C«) \gs(t - r) + u r C 4 (i - r) + fl(t - r) + s(t - r)]} dt. 
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Furthermore, similar to the results in (|52p . we have that 

X lj2 = (l + (l))K li2 (l + A 1 )- d / 2 ^ +1 e5< +A ^^- 
x e (i+A 1 )K+c„)((i+Cn)^+|y T (^-z)- 1 5+^ : ) 

where 



1 ' M22 1 
8 CT 2 



(57) 



Kl,2 



/ 



e 2 



| S -(l+Al)V2( UrKu )l/2( u J-Z)-V2 S |' ds 



i(s)e(A*) c nD 



x£ 



a (l+Ai)(« T +C u )9((l+Ai)- 1 /2(u T +c«)- 1/2 K-z)- 1/2 5i,2) 



the change of variable = (1 — A) _1 / 2 (u T + "^(itl— z)~ 1 / 2 s, Si 2 is a random variable taking 
values in the set {s : t(s) G (j4*) c R-D} with an appropriately chosen density function similarly as in 
(|50|) , In summary, the only difference between Zi j2 and Z 2 lies in that the multiplier —A is replaced 
by Ai. 

We now proceed to providing a lower bound of (1 — p\ — p 2 )K + p\K\. Note that 

max{mes((A*) c n D),mes(A* n D)} > ^mes(D). 

Therefore at least one of (A*) c n D and A* n D is nonempty. If mes((A*) c D -D) > ^mes(-D), we 
have the bound 

(1 - pi - P2 )K + Pl K x > p x K x > e(l) Pl u d / 2 l h2 . 
Similarly, if mes(A* n D) > ^mes(D), we have that 

(1 - pi - /9 2 )K + piKi > 8(1)(1 - pi - p 2 )u d l 2 l 2 . 
We further split X 2 in Part 2.1 into two parts: 



•••(it + / ■■■dt 

A*nD Ja*c\D c 



— 1-2,1 +X 2]2 . 
Similar to the derivation of T\ 2 , we have that 



(58) 



±2,1 ~ K 2,i(,t — Aj ' u e 2 u 



1 M22 1 



xe 



2 ,T. 



(1-AXur+C) (l+C«)»+^r+^ 



(59) 



where 



«2,1 



e 2 



lU_(l_ A )l/2(, tT+(:il )l/2( u /-Z)- 1 /2y| 



r/.s 



t(s)eA*nD 



xE 



,(l-\){u T +C, u )g((l^\)- 1 / 2 {u T +Q u )- 1 / 2 (uI-i)- 1 / 2 S2,i) 



(60) 



£2,1 is a random variable taking values on the set {s : t(s) £ A* n D} with an appropriate density 
function similarly as in (|50lh 
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Then combining the above results of X\ 2 and X 2 1, we have that for the case in which A T < 



piKl + (1 - Pl - P2 )K > Q(l)u d / 2 [I Cl Pili,2+lc 2 (l- Pi- P2)X 2 ,i] 



(i+Ai)(u T -K«)((i-K«.)t«+J^+^ 



+ 1C 2 ■ (1 - Pl - P2)K2,ie 



(l-A)(«r+C«)((l+C«)t«+jg£ + ^ 



where Ci = {/(•) : mes((A*) c flD) > ?nes(A* n £>)} and C 2 = Cf . We further insert ^4 T defined in 
([32]) , Note that on the set {A T < 0}, (1 + Xi)A T < (1 — A)^4 T and B t is bounded away from zero 
and infinity. Then, 



[1- P1 - p 2 )K + P1 K X > Q(l)u- d ' 2+1 e^< ■ e ^){^)urArHui\y?+\z\) 

Id • Pl«l,2 + IC 2 • (1 - Pl - /92)«2,1 



(61) 



Part 3 

We now put together the results in Part 1 and Part 2 and obtain an approximation for (|3ip . Recall 
that 



E Q 



< E Q ^;£ b ,£,A T >0 

[(l- Pl -p 2 )^] 2 ' 

+E Q ^;£ b ,C,Ar < 

[{l- Px - P2 )K + p 1 K 1 ] 2 ' 



(62) 



We consider the two terms on the right-hand-side of the above display one by one. We start with 
the first term 



E Q 



1 



[(l-p x -p 2 )K] 



:;£b,jC,A T > 



E Q 
+E Q 



1 



[(l- Pl -p 2 )K) 
1 



[(l- Pl -p 2 )K] 



2',Sb,C,A T > 0, i = 
-j ;£&,£, A- > 0,i = l 



.(63) 



The index r admits denstiy l(t) when % = and r is uniformly distributed over T ii 1 = 1. 

Consider the first expectation in (|63p . Note that conditional on r and 2 = 0, on the set 
C Pl {A T > 0}, (w, y, z) follows density (1 — pi — ^2)^-0 t( w i Ui z )/(X ~ P2) defined as in (|25|) . Thus, 
according to (f54~|) . we have that the conditional expectation 



; ;£ b ,C,Ar > 



z = 0,r 



< (l + o(l)) 



(l-p 1 -p 2 ) 2 ^ 2 

tf^ 1 det(r)~3 det(A/v(**)) _1/2 



(64) 



(d+l)(d+2) d 
(27T) 4 2 



(1 _ A)d /2 ud /2-l e -l<+^ + l^i 



-2(l-A)u('(l+ (l))yl r + (l)^+ (l)^) 



'A T >0,£ 



x 7 u (n<T^4 r ) x — — — — —h,Q T (w,y, z)dwdydz 

1 — P2 
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where 



7 u (x) = E 



i,T,w,y,z 



(1 - pi - p 2 ) 2 K 2 ' 

with the expectation taken with respect to the process g{t). We insert the analytic form of 
h*Q T (w, y, z) in (j25|) and obtain that 



-2(l-A) U ((l+ (l))A+o(l)^+o(l)i^) 



>o,c 

I - Pi - P2)H\ ■ U T 
1-/02 



x j u (uaA T ) x — — —h,Q T (w,y,z)dwdydz 

1 — P2 



A T >0 



j u (uaAr) exp {-2(1 - A + o(1))iUt + o(\z\ + \y\ 2 )} 



x exp < 



-\u T A T 



\P20P22 z \ 

1 - P-20P- 22 P02 



+ 



l/2-i 

-1/2 ^22 1 
M22 * 2(J 



1 - A 



y T y > dA T dydz. (65) 



Thanks to the Borel-TIS inequality (Lemma fT5j) , Lemma [18] and the definition of n in (|5ip , for 

x > 0, 7 u (x) is bounded and as b — > 00, 



E 



1 



; x > f u 



(27T) 



Thus, by the dominated convergence theorem and with H\ defined as in (|15p . as u — > 00, we have 
that 



(27T)- 



(l-pi-/0 2 )(l-/o 2 ) 2- A 
We insert it back to (EH) and obtain that 



E Q 



1 



< (l + o(l)) 



(1 - p x - p 2 fK 2 



;£ b ,C,A T > 
e-^A 



1 = 0,r 



[1 - pi - p 2 )(l - P2) 2- A 



ff^ 1 detg^j det(A / u (T (t.))- 1 / 2 

(d+l)(d+2) d 
(27T) 4 2 



(1 — A) d / 2 u d / 2-1 e - 5"?*+ Bt *+ 



1„2 J_R, 4- 1 ^2 2 1 

8^2 



Using the asymptotic approximation of v(b) given by Proposition I13| we obtain that 

1 



E Q 



[(l- Pl -p 2 )K] 



;;£b,£,A T > 0, 1 = 



< 1+Q(1) u eX \y(by 

- 1 - Pi - P2 A(2 - A) W 



(66) 



(67) 



Note that as 6 goes to infinity, pi,p 2 , and 77 are positive converging to and A is smaller than and 
converging to 1. Then, the right-hand-side of the above inequality is bounded by (1 + e)v 2 (b). 

The handling of the second term of (|63|) is similar except that (w, y, z) follows density h*(w, y, z). 
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Thus, we only mention the key steps. Note that 
1 



E Q 



;;£ b ,£,Ar>0 



i = l,r 



(l + o(l)) 



det(r)" 



H' 1 det(T)-3 det(A// CT (t*))- 1 /2 



(ri+l)(d+2) d 
(27T) 4 2 



(1 _ A) d / 2 « rf / 2 - 1 e -3<+^ +i # : 



(rf+l)(d+2) 

(2tt) 4 



7„(«a^l T )e' 



-2(l-A)uA Te 2 



T , !™-M20' J 22 lz l 2 i T -1 



/.A T >0,£ 

0(1)(1 - Xy'u' 1 -u d - 2 e-<. 



dA T dydz 



(68) 



According to the asymptotic form of v(b), we have that for properly chosen p 2 and A (e.g. p 2 
1 - A = 1/logn) 



E Q 



1 



[(1- Pl - P2 )K] 



2 ' 



£"6, £, „4 r > 0, z = 1 



0(1)^(1 - A)-^" 1 • u d - 2 e- u "t* = o{l)v\b). (69) 



Therefore, combining the results in (|67p and (|69p . we have the first term in (|62p is bounded by 
(1 + 2e)?; 2 (6). 

The last step is to show that the second term of (|62p is of a smaller order of v 2 {b). First, we 
split the expectation 



E Q 
E Q 

+E Q 
+E Q 



1 



[(1 - pi - p 2 )K + Pl K x 
1 

[(1 - pi - p 2 )if + pii^i 
1 

,[(l-p 1 -p 2 )^ + pi J FCi] 
1 

.[(l-pi-p 2 )^ + PiA'i] 2 
We study these three terms one by one. Let 

1 



I 



(70) 



r ; —f]/u T < A T < 0,i = 



;£b,C,A T < —r]/u T ,z = 



[I Cl • PlKl,2 + Ic 2 • (1 - Pi ~ ^2)^2,1] 



■ , X > £ u 



i,T,w,y,z 



(71) 



We start with the first expectation in (|70p . Plugging in the lower bound for (1 — p\ — P2)K + p\K\ 
derived in (IBTT). we have 



[(1 - Pi - P2)K + piATi] 



l = l,T 



(72) 



0(l)u d - 2 e _u ** x 



Ar<0 



71 



T , l™-M20' J 22 lz | 2 1 T -1 

y y+- =t ^ z M22 z 

l-M20' J 22 M 02 



dA T dydz. 



We deal with the , yi jU (uaA T ) term in the above integration. On the set C, uaA T > — u 3 / 2+e . By 
Lemma [231 for — u 3 / 2+e < x < 0, there exists a constant 5* > such that 



E 



1 

22 ' *^ ' u 

Pl K l,2 



i,r,w,y,z,Cl 



0{l)pl 2 e u6 * x . 
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and 



E 



(1 - pi - p 2 ) 2 K 



"2,1 



i,r,w,y,z,C2 



du x 



0(1)(1- P1 - P 2)^(1-A)-V 



Therefore, the above approximations and the dominated convergence theorem imply that condi- 
tional on C, 



[ -f hu {uaA T )e^ 1+x ^ uA ^dA T = 0{l) ■ maxjft 2 , (1 - \y d ] ■ 



-is* 



'A T <o 

Thus, ([72]) equals 

(UJ) = 0(l)max{p^ 2 ,(l-A)- d }-n- 

Taking expectation of the above equation with respect to i and r and properly choosing the con- 
vergence rate of p\,pi and 1 — A, we have 

1 



E 



[(1 - Pi ~ P2)K + pxKx] 



; ;£ b ,C,A T < 0,i = l 



o(l) •u d - 2 e- u ?. = o(l)v 2 (b). (73) 



For the second term in (|70p . with the same bound of 71 u and carefully chosen parameters, we 
have 



E Q 



1 



[(1 - Pl - p 2 )K + Pl K x ] 



r,£b,£, -i]/u T < A T < 



1 = 0,r 



0(l)u d - 2 e-< x u T 



^<A<o 



x exp 



—i 12 
1^20/^22 z l 



+ 



1/2 1 

-1/2 ^22 1 
^22 z 



1 - M20M22V02 2cJ 

= 0(1) • max{p^ 2 , (1 - X)~ d } ■ u' 5 * ■ u d - 2 e~< 
= o(l)v 2 (b). 

and similarly for the third term in (|70j) . 



1-A 



y T y > dA T dydz 



E Q 



1 



[{l-p 1 -p 2 )K + p 1 K l ] 2 
0(l) Pl ■ u d - 2 e-< 



;£b,£,A T < -r//u 7 



Xli, 



Ar< 



7l , u (naA T )e- 2 ^^e XlUTAT ~ k 



l = 0,T 



lM2QM 2 2 



-I 

1-M20' 1 22 M 02 



1/2, 

-1/2 M 2 2 1 
^22 2 2ct 



1 + ^1 T 

— 2^y y 



0(l)pi • max{/^ 2 , (1 - \)~ d } ■ vT°' ■ u a ~' l e 
o(\)v\b). 



dA T dydz 



(74) 



Thus, we put all the estimates in ([67]), ([69]), ([73]), and ([TJ]) back to ([62]). Then, for any e > 0, 
we can choose pi, /t?2, f? small and A close to 1 (e.g., f] = p\= pi = \ — A = 1/ log u) such that for 6 
sufficiently large 



E Q 



dpy _ . 



< (l + 3e)v 2 (6). 



We complete the proof of Theorem [3] for the case that p(t) / 0. 
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3.4 Case 2: constant mean function. 

The proof when fi(t) = is very similar, except that we need to consider two situations: first, r is 
not close to the boundary of T and otherwise. More precisely, for a given 5' > small enough, we 
consider the case when r G {t : \t — r| < u~ 1 ^ 2+s } C T and otherwise. 

For the first situation, r is "far away" from the boundary of T, which is the important case, 
the derivation is same as that of the case where n(t) is not a constant. For the case in which r is 
within u~ l l 2+& distance from the boundary of T, the contribution of the boundary case is o(v 2 (b)). 
An intuitive interpretation is that the important region of the integral X{T) might be cut off by the 
boundary of T. Therefore, in cases that r is too close to the boundary, the tail I(T) is not heavier 
than that of the interior case. The rigorous analysis is basically repeating the Parts 1, 2, and 3 on 
a truncated region. Therefore, we omit the details. 



4 Proof of Theorem |4] 

The proof of Theorem 0] is analogous to that of Theorem According to Lemma [T7\ we focus on 
the set C A similar three-part procedure is applied here. 

In Part 1, using the transformation from / to the process we have 

P U (T) = sup(/(t) + i-^ + ^+/v(i) 



teT L 2au t u t 



teT 



1 (z t -u t no2 + u T n 2 (t-T)) B 



sup U{t) + u T C(t - r) + ^ tf T X - + — + M*) 



2aut ut 



We insert the expansions in (|34p . (|35p and (|36p into the expression of /3 U (T) and obtain that 



1 



f3 u (T) = sup\w + y T (t-T) + -(t-T) T z(t-T) + g 3 (t-T) + R f (t-T)+g(t-T) 



+u T (l ~\{t- r) T (t - r) + C 4 (t - r) + R c (t - r) 
+M«r(r) + dfi a {r) T {t - r) + ^(t " r) T A^(r)(t - r) + a -1 ^^ - r) 

, l T (z 4 - U t /i 2 + U T fJ, 2 (t -t)) B t 



2au t u t 

= sup j u + w H — y T (ul — z)~ 1 y (t — r — (ul — z) _1 y) T (tt/ — z) (t — t — (ul — i)~ l y) 

teT I 2 2 

+53 (t - r) + u T C 4 (t-T) + R(t-T) + g(t — r) H 1 

2cru t u t 

Note that the above display is approximately a quadratic function of t — r and is maximized 
approximately at t — r = (ul — z) _1 y. In addition, on the set C, we have that |r — t*| < ti _1 / 2+e 
and thus y = y + 0(u _1 ' 2+e ). Therefore, on the set C, we have the following approximation of 

Pu{T) 

A T + inf g(t) < p u (T) -u + o{u~ v ) < A T + sup y(t). (75) 

|t-T|<U-V3+* |t-r|<«-V2+ e 

Then, f3 u (T) > ti if „4 T + o p (u _1 ) > 0. Thus, we obtain the same representation as in Part 1 in the 
proof of Theorem [3j 
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Since we use the same change of measure, the analysis of the likelihood ratio is exactly the 
same as Part 2 of Theorem [3j For Part 3, we compute the second moment of dP/dQ on the set 
{/3 U (T) > u}. This is also identical to the proof of Theorem Thus, with the same choice of 
tuning parameters, we have that 



E Q 



dP 
dQ 



:Pu(T) > u 



< (l+e)v\b). 



Additionally, Lemma 1171 provides an approximation that P(f3 u (T) > it) ~ v(b). Thus, we use 
Lemma [12] (presented at the beginning of Section [3]) and complete the proof. 



5 Proof of Theorem [9] 

For the bias control, we need the following result that is proved in [35 



Proposition 14 Suppose that conditions Cl-6 are satisfied. Let F'{x) be the probability density 
function o/logX(T) = log J T e a f^ + ^dt. Then the following approximation holds as x — > oo 

F'{x)~o-- 2 x-v(e x ). 

Thus, for any small e, 

P{b<X(T) < 6(1 + ej log b) | Z(T) > b) = 6(e). (76) 
Similar to the log-normal distribution, the overshoot of X(T) is 0(6/ log fe). Note that 
\v M {b) - v(b)\ < P(X(T) > b,l M (T) <b) + P{1{T) < b,l M (T) > b). 

Let 

£ £ = {sup|a/(t)| <2(l-^ 2 loge)n}. 

teT 

Note that df(t) is a d-dimensional Gaussian process. Using Borel-TIS lemma, we obtain that 

P(C c e ) = o(l)e-v(b), 

it is sufficient to control P{X{T) > b,l M {T) < b,C £ ) and P(T{T) < b,T M (T) > b,C £ ). 
By the definition of Im in ()22|) . there exists a constant c\ > such that 



A = \1(T)-1 M (T)\ < 



i=l 



e*/(t)+M(*) dt _ mes(T N (ti)) ■ e af ^ )+fl ^ 

T N (U) 



< Cl min{X M (T),X(r)} • sup \8f(t)\/N 

Then we have, on the set C e , A < 2c\ min{Xj\/ (T),X(T)}(1 — u~ 2 log e)u/N, which implies that 

u(l — u~ 2 loge) log b 



P{1{T) > b,I M {T) < b,£s) < P(b<l(T) < 6(l+2(l-u^ loge)n/iV)) = 0(1)- 



N 



The last step is due to the result of Proposition [H] and further (jT6|) . Thus, it is sufficient to 
choose N = O(e^ 1 ~ £0 u 2+£o ) so that the above probability is bounded by ev(b). The bound of 
P(Z(T) < 6, Zm(T) > b,C £ ) is completely analogous. 
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6 Proof of Theorem [10 



The proof of Theorem [10] is similar to that of Theorem [3l Therefore, we only layout the key 
steps. The only difference is that we replace the integral by a finite sum over T/y. Recall that the 
proof of Theorem [3] consists of three parts: first, we write the event {Im(T) > b} as a function of 
(w,y,z) (with an ignorable correction term); second, we write the likelihood ratio as a function of 
(w,y,z) (with an ignorable correction term); third, we integrate the likelihood ratio with respect 
to (i,T,w,y,z). For the current proof, we also have similar 3 parts. 

Part 1. For the first step in the proof of Theorem[3l we write I(T) > b if and only if A T +o{u~ l ) > 
u a £ v . With the current discretization size, as proved in Theorem [9l 

logX(T)-logX A/ (T) = (n" 1 ). 

Thus, we reach the same result that Zm{T) > b if A T + o(n _1 ) > u o 



Part 2. Consider the likelihood ratio 



dQ 
dP 



T 



(1 - pi - P2 )l(t)LR(t) + Pl l(t)LRi(t) + 



P2 



mes(T) 



LR 2 (t) 



dt. 



Under the discretization setup, we have 

dQM = 1-P1-P2 £ mLR{U) + P±ST JfejMxfe) + P2 E ^LR 2 ( U ), 



M 



M 



i=l 



i=l 



i=l 



which is a discrete approximation of dQ/dP. In the proof of Theorem [31 after taking all the 
terms not consisting of t out of the integral (such as that in (|49|) ) , the discrete sum is essentially 
approximating the following integral 



\t~r\<u 



-l+6> 



exp 



(i-A)K + c«) 



t-T- (ul - zy 1 ^ (ul -z)(t-T- (ul - z)~ l y) \ dt. 



The above integral concentrates on a region of size 0(u 1 ). Given that we choose N > u 2 , the 
discretized likelihood ratio in dQuldP approximate dQ/dP up to a constant in the sense that 



dQn = Q (1 \ d Q 
dP " { 'dP 



(77) 



Part 3. With the results of Parts 1 and 2, the analysis of Part 3 is completely analogous to Part 
3 in the proof of Theorem [3l Thus, we conclude that 

E Q *'{L 2 b ) < Kl v(b) 2 , 

where the constant k\ depends on the 0(1) in (|77j) . 
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7 Appendix: The Lemmas 



In this section, we state all the lemmas used in the previous section. To facilitate reading, we 
move several lengthy proofs (Lemmas [16l [171 \W\ EH [22], and [23|) to the supplemental materials, as 
those proofs are not particularly related to the proof of the theorems and mostly involve tedious 
elementary algebra. 

The first lemma is known as Borel-TIS lemma, which was proved independently by [181 147]. 



Lemma 15 (Borel-TIS) Let f(t), t € U, IA is a parameter set, be mean zero Gaussian random 
field, f is almost surely bounded on U. Then, 



and 



where 



£(sup/(i)) < oo, 
u 



P(max/ (i) - E[max.f(t)] > b) < e 



°u = max Var [fit)}. 



Lemma 16 Conditional on the set C as defined in ()37p . we have that 

2 



E Q 



dP 
dQ 



;X(T)>b,C c 



o(l)v\b). 



Lemma 17 On the set C as defined in (1371) . we have that 

2 



E Q 



dP 



dQ )-MT)>u,C< 



o(l)P(p u (T) >u)\ 



dP 
dQ 



■p u {T)>u,C c 



o(l)P (P U (T) > u) . 



In addition, we have the approximation P (/3 U (T) > u) ~ v(b). 

Lemma 18 Let £ u be as defined in {4$ , then there exists a constant w > such that for all x > 

P (V/ 2 - 3 %| > x) < e~ mx2 + e~ mu \ 



for u sufficiently large. 

Proof of Lemma 1181 We split the expectation into two parts {|S| < u 5 } and {\S\ > u s ,t + 
(ul — z) -1 / 2 ^ £ T}. Note that \S\ < ku s and g(t) is a mean zero Gaussian random field with 
Var(g(t)) = 0(|t| 6 ). A direct application of the Borel-TIS inequality (Lemma ll5|) yields the result 
of this lemma. ■ 

Lemma 19 Let S be a random variable taking values in {s : (ul — z)~ 1 / 2 s + r £ T} with density 
proportional to 

' s-(ul -z)-^ 2 i 



exp 



If\y\ < u l ' 2+£ and \z\ < u l ' 2+e , th 



en 



log {E exp ag 3 ((ul-z)~^s) + a (u - /v(t)) C 4 ((ul - z)~^s] + aR ((ul - z)~5 S^j } 
~h + V«) T ^ + VO + ^ + ^ £ *.C(0) + o („-) , 



where the expectation is taken with respect to S and Y = {yf,i = 1, ...,d;2yiyj, 1 < i < j < d}. 
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Lemma 20 



log(det(J - n _1 z)) = -n _1 Tr(z) + ^n~ 2 I 2 (z) + o(n~ 2 ), 



where Tr is the trace of a matrix, l2(z) = Y2i=i ^H> an d ' s are the eigenvalues of z. 

Proof of Lemma 1201 The result is immediate by noting that det(I — u~ 1 z) = J]^ =1 (l — Xi/u) 
and Tr(z) = Ya=i \- ■ 



Lemma 21 On the set C, T% defined as in (|47p can be written as 
exp 



A*,\t-r\<u 



-1+5' 



+ Y' XUt 



f, ,s r . nU x i, n {Z t ~ flQ2Ut + H2(t ~ t)u t ) I-V22I 

x exp <(1 - X)ut [w t + u T C(t - t) - u t \ + (1 - A) XB t 



2a 



8a 2 



x exp 



(w t + u T C(t - t) - u t ) 2 -2{w t + u T C(t - t) - u t ) p 2 oP 2 2( z t - M02^t + fJa(t - t)u 7 



2(1 - /i20M22Vt)2) 

Lemma 22 For rj > 0, on i/ie se£ £, i/^4 r > 0, i/ien 

{|t-r| < n~ 1+<5 '} C A*. 

Lemma 23 Consider that {t : \t — t\ < n _1 / 2+<5 } C T . There exists some 5* > such that for all 

_ u 3/2+e < -j; < 0, 

1 



dt. 



E 



Pl K l,2 



i,T,w,y,z,Ci 



2 m" x 



and 



E 



I % fit 



i,T,w,y,z,C 2 



o(i)(i- Pl - P2 y 2 (i-xr d e u \ 



(1-pl -P2) 2 K|,l' 

w/iere Ci = {mes(,4 c n D) > mes(A n I?)}, and C 2 = {?nes(A c n D) < mes(A n -D)}. 
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Supplementary materials: Proof of the Lemmas 
Proof of Lemma 1161 Define another set 

Ci = \\f(r)-u\ <n 1 / 2+e , \y\<u l / 2+t , sup \z t \ < u^ 2+e , 

sup \d 3 f(t) - u T d 3 C(t - t)\ < n 1 / 2 ^, sup \g(t)\ < u' 1 ' 5 

\t-T\<u- l / 2 + s It-rKu- 1 / 2 - 15 

Note that C C C\. We first show that 

2 



(7S 



E Q 



dQ J Jt 



o{l)v{bf 



In this proof, we mainly use the last component of the mixture LR2(t) that has not been used in 
the main proof of the theorem. Note that dQ/dP > p2 J T LR2(t)/mes(T)dt and therefore 



E Q 
< E Q 



dP 
dQ 

P2 



. f e Kt)+*f(t) dt > hi c\ 
Jt 



(79) 



1 



T mes(T) 

_L_ [ 

mes(T) J T 



LR 2 (t)dt) ;l(T)>b,Ci 

2 



e --ui+u t f{t) dt 



AT) b 



' mes(T) mes{T) 



On the set 



1 f e ^{t)H(t)) dt = J^L > 



we have for large b, 
1 

mes(T) j T 



mes 



e -i u 2 +ut f(t) dt 



mes(T) mes(T) 



(80) 



e 2 U x 



1 



mes(T) J T 



mes(T) 



; (u-max t6T f-i(j (t)) (f(t)+fi a (t)) jj. 



Tn{f(t)+^(t)>0} 



_|_ / e (ii-min tET ^(()){/(t)+)i,(t))^ 
Tn{f(t)+^(t)<0} 

1 



> l e -|« 2 + | min teT At 2 (t) x 



mes(T) 



(«-max teT {t))(f(t)+/J,a (t)) fa 



T 



We apply Jensen's inequality to the term in the bracket and have that 



> I e -|« 2 + |min teT /4(t) x 



2 

> e 2 



1 



mes(T) 



(«-max ieT fj,cr(t))/(T 



— V? — C\U log u 



37 



where c\ is some constant. The last step of the above display uses the fact that u — log 6 = O(logu). 
Therefore, the above derivation implies that 

(USD < p 2 -2 e -« 2 +2 Cl «log« x q ( £ c) 

By Borel-TIS Lemma (Lemma I15p. we have that Q(£±) = 0(l)e~ u}ul+2 " for some u > and thus 



E Q 



(l) ft - 2 e - u2 -f" 1+2 ' = o(l)v 2 (b). 



We now proceed to bound for the rest of the expectation, that is 

2 



E Q 



dQJ 



;Z(T) > 6,£ c n£i 



This requires some fine analysis. Similar to the proof on the set Ci, we still focus on the last 
component of the likelihood ratio corresponding to LR2. Let 

£ 2 = £ c nA. 

Since £2 C £1, the rest of the derivations are on the set C\. Note that 



E Q 



dP\ , „ 

HQ) ■ I ^>"^ 



< mes 2 (T)p- 2 E Q 



e -±u 2 t +lw t +u T c(t-T)]u tdt \ . x( j^ > fe)£2 



T 



The derivation for the above expectation takes a similar three-step procedure as that in the proof 
of Theorem [3l We only state the key steps here. 

Part 1. On the set C\ and for a given r, following Part 1 in the proof of Theorem El in particular 
results in (|45p. we have I(T) > b if and only if 



where 
A = 



A' + o(u- 1 ) > u-V -1 ^ 



w + \f{ul - z)- x y - -L log det(J - u~ l i) - ^-(u^Y + l/a) r ^{u^Y + 1/a) 
1 la su 

8a 2 u 8a 2 u ^ 



Part 2. Let X u = u 1 / 2+s and we have that 



e — + [w t +u T C(t-T)]ut^ 



> e 



'\t-r\<\ u 

(1 + o(l))e u2 < / 2 ~ u ^( T )+t 1 l( T )/ 2 



e ut[w t -HtrC(t-T)+tJ, a (i)]+^nl(t) dt 

gU< [wt+ii T C(t— t)— U+Mct ( t )] ^ 



|t-r|<A„ 
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Similar to Part 1, we insert the Taylor expansion of w± and C(t — r) to the above display and 
the integral equals (( u = 0(u~ l l 2+5 )) 



a ut [wt+u T C(t— t)—u+^o- (t)] ^ 



\t~r\<\u 

(1 + o(l)) exp <j (u T + Cn) 



(81) 



/ exp I (u T + Cw) 

J\t~r\<\ u 1 



w + -y{u T I-z) 1 y 



1 



-(t - r - (tt T / - z)^i/) T Kl - z)(t - r - (u T I - z)~ 1 y) 



+ 0s (* - r) + n T C 4 (t - r) + 9 (t - r)] } 



We further restrict the interval to the region Sm = {t '■ \t — r — (u T I — z)~ - x y\ < Mu- 1 } for 
some M large. On the set Sm, ug(t — r) = o(l).Then, 



e Ut [wt+u T C(t-T)-u+ii a (r)] ^ 



'\t-r\<X u 

> (l + o(l))exp<j (u T + Cu) 



w + -y{u T I-z.) l y 



+ o(\y\' 



j exp|(u r + C«) --(t-T-(u T I-z) 1 y) T (u T I - z){t - r - (u T I - z) 1 y) j 

J S M 



dt 



I Sm 
-d 



> 5qu exp <^ (u T + (u 



w + -y(u T I-z) l y 



We insert the above result back to (|8ip and obtain that 

— §«f + [w t +U T C(t-T)]u t J£ 

1 



w+-y(u T I-z) 1 y 



+ o(\y\' 



> S^u'^ 2 exp Uu T + ( u ) 

= Q(l)u- d e u */ 2 exp {K + ( U )A' + o{\y\ 2 ) + 0(\z\)} . 
On the set C\, note that 

A' = At + o^- 1 !^! 2 ) + Oiu' 1 + n" 1 ^!). 

Then, we have that 

f e -^ t +[m+u r C(t-r)]u tdt = ®(l) u -d e ul/2 exp |( Ut + + (| y |2) + 0( | z |)| 

Part 3. With the results of Parts 1 and 2, the analysis of this part is completely analogous to Part 3 
of the proof of Theorem [3l For i = 0we have that 



E Q 



T 



e -\ul + [w t+ u T C{t-r)]u tdt \ .j-^ >b ^ 27 l = 



0(l)u 2d E Q [e~ u *E® T [ e -^-r+Cu)A T +o(\y\z)+0(\z\). X ( T) >b];\r- t*\ > vT 1 l 2+ \i = o} 
+0(l)u 2d E® {e~<E^ T [ e -2K+C.)X+o(| y | 2 )+o ( |,|). x(r) > . | r _ ^ < n -i/2+^ : 
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The first term is on the set |r — i*| > u 1 / 2+e and therefore e u ^ < e "** 11 . For the second 
term, on the set |r — 1*| < u~ 1 / 2+e , we have |y| > u e or sup > u e , the inner expectation is 



E® 



-2(u T +Cu)A T +o(\y\ 2 )+0{\z\). 



l(T)>b,£ 2 



0(l)e- u2e / 2 . 



For the case that i = 1, the handling is similar. Therefore, the overall contribution is 



E Q 



e -lu 2 t +[w t +u T C(t-r)]u tdt \ ;X ( T ) > &i£2 



o(l)v 2 (b). 



Thereby, we conclude the proof. ■ 

Proof of Lemma 1171 The proof of Lemma [T7] is analogous to that of Lemma [16l We only show 
the key steps here. 
Consider the set 



C 3 = < sup \f(t)\<Mu, sup|d/(i)| < M 2 u, sup \d 2 f(t)\ < M 2 u 

IteT t&T tGT 

where M is some big constant. By the Borel-TIS lemma, we have 
~dP 



E Q 



dQ 



■p u {T)>u,£% 



P((3 u (T)>u,£ c 3 )<P(£ c 3 ) = o(l)v(b). 



For the second moment, we have that 

2 



E Q 



E 



< E 



< E 



e 2"« 



uf+ut] 



Mdt) ;£ 



u 2 +usup \f(t)\ . nc 



We can always choose M large enough such that the term is of order o(v 2 (b)). On the set £3, let 
tsup be the maximum of f(t) that is f(t sup ) = sup igT f(t). Then, there exists constant c\ such that 



LR 2 (t)dt 



e ~2 u i + u tf(t) fa 



> 



e -lu 2 + u t f(t) dt 



\i tsupl^u 2 e 
2 1 

> e 2^ — HtT{tsup)_ 



Now consider the set £\ defined in ([78]) . we have 



E Q 
< E Q 



dP\ 

;(3 u (T)>u,£ c 1 n£ 3 



(82) 



(83) 



l —LR 2 {t)dt ) 



mes 2 ^) eQ 



e 2 



T 



\ ~ 2 

\u$+u t f{t) dt \ . p^yy >u ^ C c n £ 3 
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Then, on the set £3, there exists a constant C2 such that 



HI < 



< 



mes2 ( T l E Q 



Pi 



e -,u t+ u t m dt ■ fU) > u - pa, l\ n £3 



mes 2 (T) 



Pi 



E Q 



e 2 



-+«/(tsup) 



;f(t sup ) >u-c 2 ,£;n£ 3 



where in the last step we plugged in the bound in (|82p . Therefore there exists a constant C3 such 
that 

© < p 2 " 2 e- u2+2c3?tlogu Q (£$ n £ 3 ) • 



Then the Borel-TIS Lemma implies that on the set C\ , there exists a positive constant such that 



E Q 



(g) ;^(T)>„,^ 



(l)^ 2 - 2 e-« 2 -« 1+ro = o(V(&). 



With exactly the same argument, we have that 

E Q 



dP 

^■MT)>u,Cl 



o(l)v(b) 



Now on C\, with a similar three-step procedure explored in the proof of Lemma [TBI we can obtain 
that 



E Q 



dpy 

dQJ ; 



f3 u (T) >u,C c 



Kl)v 2 (b), E Q 



dP 
dQ 



■p u {T)>u,C c 



o(l)v(b). 



With a similar derivation as in Theorem (3J we obtain that 

P(p u (T)>u)~v(b). 
The detailed derivation of the above asymptotic approximation is omitted. ■ 
Proof of Lemma 1191 For 5 > e, we first split the expectation into two parts: 



E 



E 



exp [ag 3 ({ul - z)~^s) + a{u - /U ct (t))C 4 ((ul - z) - ^) + oR ({ul - *)~%S\ } 



...;\S\ <u S +E ...;\S\ > u 



= Ji + h- 

Let t = (ul — z)~2s. Given that C(t) is a monotone non-increasing function, we have that for 
all \s\ = 0(u s ) 

- a -(s - (ul - .)" Wy) T (s - (ul - z)" V2jJ 

+0"53 ( — z)~2s j + cr(n — ^(r))^ ( (u/ — z)~2s ) + ai? ( (it/ — z)" § 



t-(ul - z)'/ 2 y ) (ul - z) ( t - (uJ - z)^/ 2 y 



+cj 9 3(t) + <r(u - u a {T))C 4 {t) + cri?(i) 
< -\u\t\ 2 = -As 2 . 
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J 2 = O e 



Therefore, for A' small 

We now consider the leading term J\. One the set that \S\ < u & and \y\ < u l l 2+e , we have that 
ag 3 ({ul - z)-*s) + a{u - /i CT (r))C 4 f(uJ - z)~3S) + aR ({ul - z)~^s) = O (V 1+45 ' 



By using Taylor's expansion twice, we can essentially move the expectation into the exponent and 
obtain that log J\ equals 



ag 3 ({ul - z)~^s) + a{u - ^{t))C a ({ul - z)~^S) + aR ({ul - z)~^S) ;\S\< u 5 ] +o (m^ 1 ) . 



E 



Note that {ul - z)- x l 2 y = u~ x l 2 y + 0{u~ 3/2 \y\ \z\) and y = y + 0(1). Let Z = {Z 1 ,...,Z d ) be a 
multivariate Gaussian random vector with mean zero and covariance function <t -1 /. Then, S is 
equal in distribution to Z + u~ l l 2 y + 0{u~ 3 / 2 \y\ \z\). Therefore, we obtain that 



log Jl 

a + 0{u- 1+f -] 
6 



u- 3/2 ^2df Jkl c{o)E [{u-^m + Zi){u-y% + Z^vrWyu + z k ) 

ijkl 



Vl 



+ ° + 1+£ ) u -iJ2 d 4. kiC{0)E [ (u -i/2 ft + zOCu" 1 ^ + Z 3 ){u- l ' 2 y k + Z k ){u^y x + Z,) 

ijkl 

+o(n" 1 ) 



6 



^4 M C(0)E {u^y t + Zi)^- 1 / 2 ^- + Z^uWy* + Z fe ) 



ijkl 



+ YA U ~ l E 4fc^(°) E [(^ 1/2 ^ + z i)(»- 1/2 Vj + Zj){u- X l 2 y k + Z fc )(«~ 1/2 M + z,) 



+ O (it 



where the expectations are taken with respect to Z. Then 
log Jl 

6 

+TA U ' 1 E Qdf tkl C{0)u- l y k yi + ^ E d ^ C ^ + ° ( u ~') 



J2dtj k iC{0)yiyjy k yi - V 3 / 2 ^Sd^O)^ 1 / 2 



VkVl 



ikl 



1.1.1:1 



^3 E ^kicmmyi - ^2 E ^aok 1 /^ + ^ E ^(°) + ° K 1 ) 

ij'fci iifcZ iiii 



Proof of Lemma 1211 This proof only consists of elementary algebra. We expand the exponent 
in the second row and the second term in the third row of (|47p . Furthermore, we move the first 
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term in the third row to the last row and move the last term in the fourth row up to the third row. 
Then, we obtain that 

ut*(t ~ t*) T (U)(t — U 



2a 8a' 

■{Zt ~ V02U t + [i 2 (t - T)u T ) T {I22 ( z t ~ V02U t + ~ T)U T ) 



1 2 = exp 

J A* ,\t-T\<u- 1 + s ' 

f \ , \ / nt4. \\ , M \\ lT ( Z t ~ + ^2{t ~ T)u T ) l T ^22l 

xu t x exp <j -Xu t w t + \ut{u t - u T C(t - r)) + (1 - A) — — — - - \B t 

x exp 
+ 

j (w t + u T C{t - r) - // 20 //22 1 (^ + - r)u T )) 2 \fx^J^jzt ~ i^H + ^{t - t)u t )\ 2 1 

[ 2(1 - //20/^22 M02) 2(1 - //20M22 M02) J 

We now work on the exponents in the third and the last row. In particular, we have that 

-{zt - tM&Ut + Mgft ~ T ) u r) J IH2 ( z t ~ (My2Ut + - r)u T ) (z t + fj, 2 (t - t)u t ) t fi^jjzt + (Ja(t - t)u 7 



2 

[zt + /U 2 (t - t)u t ) t fi^ (z t + /U 2 (i - t)u t ) 



(u>t + U T C(t - T) - H20H22 ( Z t + »2(t- T)u T )) |/i 2 0/i 2 2 1 (^ ~ M02«i + M* ~ t)u t )\ 2 



2(1 - j U 2 0/i22 1 A t 02) 2(1 - /X 2 oM 22 Vo2) 

-1 2 

M20^22^02^ t -1/ I / » \ \ 

= 5 ^^20^22 ( z * ~ M02^ + A*2(* - t)« t ) 

^ (wt + U T C(t - T) - jU20M22Vo2^) 2 

2(1 - M20M22V02) 

2 (w t + n T C(£ - r) - f^wfJ^J^wUt) 1^20^22 ( z t ~ VwtfH + ~ t)«t) 

2(1 - M20^22 1 A f 02) 

We further expand the last two rows and obtain that 
= + nj-wt + u t (u r C(i - r) - n t ) 

^ (wt + n r C(t - r) - u t ) 2 - 2 (w t + n r C(t - r) - tt f ) 1120^22 ~ Mog^t + A*2(* ~ t)^t) 

2(1 - ^20^22Vo2) 

We put it back to the expression of X2 and obtain that 



A* ,\t~T\<U- 1 + S> 



exp \ — 2 - + y } x ut 



x exp I (1 - Ajuj [w t + u T C(t - t) - ii 4 J + (1 - A) — \B t ^- 2 — 

J (w t + n r C(t - r) - -u f ) 2 - 2 (w t + ?yC(t - r) - u t ) 1^20^22 ( z t ~ Mo?"* + ~ t)"t) 1 

X GXp s ■; / Civ. 

I 2(1 - /i 2 0/^22 M02j 



Proof of Lemma 1221 We now consider a particular t G A*n{£ : \t — r| < u 1+<5 }. On the 
localization set C and |t — r| < , we have that 

\z t -z\ = 0(u-^ 2+8 '^), \z t \ = 0{u% \y t -y\ = 0( U - 1+S ' + *). (84) 



43 



In what follows, we show that, for all t 6 {t : \t — r| < u 1+s '}, A T > implies t E A* . On the set 
{t : \t — t\ < u~ 1+s } and the set C, by definition, t G A* if 

lot + u T C(t - r) - tit H 1 1 > -rju t +o(u ). 

2u t Zaut Ut 

We insert the expansion of f*(t) into the above inequality and obtain that 



w + y T (t -T) + -{t- r) T z{t - r) + g 3 (t - r) + - r) + g{t - r) 



u r i ,9 ^ , \ „ / \ , » ,, N lytl 2 — 2y t u T (t — t) + u^li — r\ 
~ \t - t\ 2 + u T C 4 {t - r) + u T R c {t - r) - /v(r) + ^(i) + u 



2 1 ' ~ v ' r " x ' r " w 2u f 

l T (z t ~ W2U t +H2{t)u T ) B t -1 , / 

H 1 > -??n t + o(u ). 

2au t ut 

We further insert A T in and obtain that 



Ut / V^^t 2 y 2ut 2u T 

B t B T 1 T (z t - fi 02 u t + Li 2 (t)u T ) l T z 

+ + o O /W) 

+-(t - r) T z(i - r) + ga ft - r) + R f (t - r) + 5 (t - r) + u T C 4 (t - r) + u TJ R c ft - r) 

Many terms on the left-hand-side of the above inequality are in fact 0(u~ l ~^' +e ). Thus, we have 
that t £ A* if 

At + t]^" 1 > -g(t - t) + o(vT l ). 
In addition, supi t _ T | <w _i+i' \g(t)\ < u^ 1 ^ 6 . Thus, for all {t : \t — r\ < u~ 1+s '}, 

te A* <^> A T > -Wt 1 + o(n _1 ). 
Note that r/ > is fixed. Thus, we have 

A T > =► {t : \t - t\ < u- 1+5 '} C A*. 



Proof of Lemma 1231 To simplify the notation, let r = 0. For other values of r, the derivation 
is completely analogous. We use the notation E w ^ tZt d[-] to denote E [-\w, y, z, Cj\ and P w ,y,z to 
denote the conditional probability given w,y,z. 
Note that 

e -£u/u = E L 9 ((«/-z)- 1 /2 5 ) 

where S is a random variable with density proportional to (j42]). 

The statement of the lemma considers x < 0. In the proof, we slip the sign and consider 
< x < u 3 / 2+t . Thus, we have that 

{-x>H u } = {A 1 + A 2 >e x / u }, 
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where 

Ay = E 

A 2 = E 
Furthermore, we have that 



3 flr(( U J-Z)-V25). ^1 ^ ^ 

a9 ((uI- Z )-^S). | 5 | > u 8 f {uI _ Z yl/2 S G T 



log^i < sup g(s) 

\s\<u- 1 / 2 + s 



and by the Borell-TIS inequality (Lemma [15]), we have that 



P\u- sup 5 ( S )>x <e- A " u1 - 6 ^ 2 

V |s|<«- 1 / 2 +' 5 / 

In addition, on the set £, the process g is localized and 



"1,2 



o(u- S np ]s ^ u _ 1/2 _ 6 \g(a)\) = 0(u~ s ) 



Therefore, for some 5* small enough, we have that 



E 



w,y,z,Ci 



< E 



w,y,z,C\ 



Kll- A x + A 2 > e x / u ,0< A 2 < e~ Xu2 



\s\<u-V 2 + s 



At 



< e 

Similarly, since 



«i? = e(i)(i 



^)-rf e ("- SU P| S |<n-l/2-^ l9( S )l) 



0(l)(l-A)- d e 



we have 



E 



-Xu 2S 



0(l)(l-\)- a e 



w, y ,z,c 2 k^Ai +A 2 > e x/u ,0 <A 2 <e 
For the remainder terms, consider C\ first 

E w , y , z , Cl \>Hi A 1+ A 2 > e x ' u ,A 2 > e~ Xu 
< E W) y >z>Cl k.i 2 ] A 2 >e 



d-S 



Ew,y,z,Ci 

Since for A and A' sufficiently small 



su p g{s/Vu) - -s 2 > -\u 25 



u s <s<^/u 



w,y,z I ^2 



Ao > e 



-\u 2S 



< P 



sup g(s/\/u) — -s 2 > —Xu 



.U S <1 
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for all < x < u 3 / 2+e , therefore 



"1,2 



sup g(s/y/u) — -s 2 > —Xu 2S 

U S <S<yfTl ^ 



e~ E, 



w,y,z,Ci 



e -\'u 2 e O(u- s ) < e -u s *x 



II 



sup g(s) — — s > —Xu 

s6T,|s|>!l- 1 /2+<5 2 



.25 



Similarly, for C 2 is true, by (|86|) . the following bound holds. 



k 2 \- A 1 + A 2 > e x/u ,A 2 > e 



Ew,y,z,C'2 
— e J - J w ) y,z,C2 



Xu 2 



"2,1 



U 



sup g(s) s > — Au 

seT,|s|>«- 1 /2+<5 2 



.2<5 



= 0(1)(1 - \y d e~ x ' u2 = 0(1)(1 - A)~ d e- u5 x . 
Combining the above results, we have the conclusion. ■ 
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